2026-02-13T20:03:17.805 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-13T20:03:17.822 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T20:03:17.900 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49983 branch: wip-yuri4-testing-2026-02-11-2126 description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '49983' kernel: branch: distro kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri4-testing-2026-02-11-2126 ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 workunit: branch: wip-yuri4-testing-2026-02-11-2126 sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 5319 sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri4-testing-2026-02-11-2126 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 targets: trial030.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ62VANxAzkZEQv2fatjfOJ9pz3FrztYOBKm5cF923Yc8PHLnyP67Hwe+TMaMaMvJbcHFa8lj4k1HaY7CsusvhE= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - osd teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8bec0da71becad44414c54979f64c9ef0e7099c6 timestamp: 2026-02-13_16:37:03 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-13T20:03:17.900 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa; will attempt to use it 2026-02-13T20:03:17.901 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa/tasks 2026-02-13T20:03:17.901 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-13T20:03:17.902 INFO:teuthology.task.internal:Checking packages... 2026-02-13T20:03:17.902 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'afefaa40503a4bf024e96f97dd7f852b75f00ad6' 2026-02-13T20:03:17.902 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-13T20:03:17.902 INFO:teuthology.packaging:ref: None 2026-02-13T20:03:17.902 INFO:teuthology.packaging:tag: None 2026-02-13T20:03:17.902 INFO:teuthology.packaging:branch: wip-yuri4-testing-2026-02-11-2126 2026-02-13T20:03:17.902 INFO:teuthology.packaging:sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-13T20:03:17.902 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri4-testing-2026-02-11-2126 2026-02-13T20:03:18.025 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5230-gafefaa40-1jammy 2026-02-13T20:03:18.027 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-13T20:03:18.038 INFO:teuthology.task.internal:no buildpackages task found 2026-02-13T20:03:18.039 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-13T20:03:18.053 INFO:teuthology.task.internal:Saving configuration 2026-02-13T20:03:18.059 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-13T20:03:18.070 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-13T20:03:18.139 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial030.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49983', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 19:59:47.783566', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBR8hZPtQ2iDYTemYB8mSK1isKVidQN3Ayk3rn6HMAMB'} 2026-02-13T20:03:18.139 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-13T20:03:18.152 INFO:teuthology.task.internal:roles: ubuntu@trial030.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-13T20:03:18.152 INFO:teuthology.run_tasks:Running task console_log... 2026-02-13T20:03:18.239 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x70107f5dec00>, signals=[15]) 2026-02-13T20:03:18.240 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-13T20:03:18.251 INFO:teuthology.task.internal:Opening connections... 2026-02-13T20:03:18.251 DEBUG:teuthology.task.internal:connecting to ubuntu@trial030.front.sepia.ceph.com 2026-02-13T20:03:18.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial030.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T20:03:18.317 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-13T20:03:18.330 DEBUG:teuthology.orchestra.run.trial030:> uname -m 2026-02-13T20:03:18.397 INFO:teuthology.orchestra.run.trial030.stdout:x86_64 2026-02-13T20:03:18.397 DEBUG:teuthology.orchestra.run.trial030:> cat /etc/os-release 2026-02-13T20:03:18.443 INFO:teuthology.orchestra.run.trial030.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-13T20:03:18.443 INFO:teuthology.orchestra.run.trial030.stdout:NAME="Ubuntu" 2026-02-13T20:03:18.443 INFO:teuthology.orchestra.run.trial030.stdout:VERSION_ID="22.04" 2026-02-13T20:03:18.443 INFO:teuthology.orchestra.run.trial030.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-13T20:03:18.443 INFO:teuthology.orchestra.run.trial030.stdout:VERSION_CODENAME=jammy 2026-02-13T20:03:18.443 INFO:teuthology.orchestra.run.trial030.stdout:ID=ubuntu 2026-02-13T20:03:18.443 INFO:teuthology.orchestra.run.trial030.stdout:ID_LIKE=debian 2026-02-13T20:03:18.443 INFO:teuthology.orchestra.run.trial030.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-13T20:03:18.443 INFO:teuthology.orchestra.run.trial030.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-13T20:03:18.443 INFO:teuthology.orchestra.run.trial030.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-13T20:03:18.443 INFO:teuthology.orchestra.run.trial030.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-13T20:03:18.444 INFO:teuthology.orchestra.run.trial030.stdout:UBUNTU_CODENAME=jammy 2026-02-13T20:03:18.444 INFO:teuthology.lock.ops:Updating trial030.front.sepia.ceph.com on lock server 2026-02-13T20:03:18.530 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-13T20:03:18.541 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-13T20:03:18.553 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-13T20:03:18.553 DEBUG:teuthology.orchestra.run.trial030:> test '!' -e /home/ubuntu/cephtest 2026-02-13T20:03:18.557 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-13T20:03:18.571 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-13T20:03:18.571 DEBUG:teuthology.orchestra.run.trial030:> test -z $(ls -A /var/lib/ceph) 2026-02-13T20:03:18.604 INFO:teuthology.orchestra.run.trial030.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-13T20:03:18.605 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-13T20:03:18.696 INFO:teuthology.run_tasks:Running task kernel... 2026-02-13T20:03:18.716 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-13T20:03:18.716 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-13T20:03:18.716 DEBUG:teuthology.orchestra.run.trial030:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T20:03:18.719 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T20:03:18.719 DEBUG:teuthology.orchestra.run.trial030:> uname -r 2026-02-13T20:03:18.767 INFO:teuthology.orchestra.run.trial030.stdout:5.15.0-164-generic 2026-02-13T20:03:18.767 INFO:teuthology.task.kernel:Running kernel on trial030: 5.15.0-164-generic 2026-02-13T20:03:18.767 DEBUG:teuthology.orchestra.run.trial030:> sudo apt-get clean 2026-02-13T20:03:18.824 DEBUG:teuthology.orchestra.run.trial030:> sudo apt-get update 2026-02-13T20:03:19.321 INFO:teuthology.orchestra.run.trial030.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T20:03:19.409 INFO:teuthology.orchestra.run.trial030.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-13T20:03:19.746 INFO:teuthology.orchestra.run.trial030.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-13T20:03:19.894 INFO:teuthology.orchestra.run.trial030.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-13T20:03:20.034 INFO:teuthology.orchestra.run.trial030.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3226 kB] 2026-02-13T20:03:20.433 INFO:teuthology.orchestra.run.trial030.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [492 kB] 2026-02-13T20:03:20.445 INFO:teuthology.orchestra.run.trial030.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-13T20:03:20.446 INFO:teuthology.orchestra.run.trial030.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1254 kB] 2026-02-13T20:03:20.480 INFO:teuthology.orchestra.run.trial030.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [313 kB] 2026-02-13T20:03:20.487 INFO:teuthology.orchestra.run.trial030.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-13T20:03:20.488 INFO:teuthology.orchestra.run.trial030.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5260 kB] 2026-02-13T20:03:20.643 INFO:teuthology.orchestra.run.trial030.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [991 kB] 2026-02-13T20:03:20.666 INFO:teuthology.orchestra.run.trial030.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2959 kB] 2026-02-13T20:03:20.750 INFO:teuthology.orchestra.run.trial030.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [425 kB] 2026-02-13T20:03:20.760 INFO:teuthology.orchestra.run.trial030.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-13T20:03:20.760 INFO:teuthology.orchestra.run.trial030.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1017 kB] 2026-02-13T20:03:20.792 INFO:teuthology.orchestra.run.trial030.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [224 kB] 2026-02-13T20:03:20.801 INFO:teuthology.orchestra.run.trial030.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.6 kB] 2026-02-13T20:03:20.801 INFO:teuthology.orchestra.run.trial030.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5089 kB] 2026-02-13T20:03:20.947 INFO:teuthology.orchestra.run.trial030.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [963 kB] 2026-02-13T20:03:24.148 INFO:teuthology.orchestra.run.trial030.stdout:Fetched 22.7 MB in 3s (7874 kB/s) 2026-02-13T20:03:24.664 INFO:teuthology.orchestra.run.trial030.stdout:Reading package lists... 2026-02-13T20:03:24.678 DEBUG:teuthology.orchestra.run.trial030:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-13T20:03:24.711 INFO:teuthology.orchestra.run.trial030.stdout:Reading package lists... 2026-02-13T20:03:24.820 INFO:teuthology.orchestra.run.trial030.stdout:Building dependency tree... 2026-02-13T20:03:24.821 INFO:teuthology.orchestra.run.trial030.stdout:Reading state information... 2026-02-13T20:03:24.906 INFO:teuthology.orchestra.run.trial030.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T20:03:24.906 INFO:teuthology.orchestra.run.trial030.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T20:03:24.906 INFO:teuthology.orchestra.run.trial030.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T20:03:24.906 INFO:teuthology.orchestra.run.trial030.stdout: sg3-utils-udev 2026-02-13T20:03:24.906 INFO:teuthology.orchestra.run.trial030.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T20:03:24.906 INFO:teuthology.orchestra.run.trial030.stdout:The following additional packages will be installed: 2026-02-13T20:03:24.906 INFO:teuthology.orchestra.run.trial030.stdout: linux-generic linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-13T20:03:24.907 INFO:teuthology.orchestra.run.trial030.stdout: linux-headers-generic linux-image-5.15.0-170-generic 2026-02-13T20:03:24.907 INFO:teuthology.orchestra.run.trial030.stdout: linux-modules-5.15.0-170-generic linux-modules-extra-5.15.0-170-generic 2026-02-13T20:03:24.907 INFO:teuthology.orchestra.run.trial030.stdout:Suggested packages: 2026-02-13T20:03:24.907 INFO:teuthology.orchestra.run.trial030.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-13T20:03:24.919 INFO:teuthology.orchestra.run.trial030.stdout:The following NEW packages will be installed: 2026-02-13T20:03:24.919 INFO:teuthology.orchestra.run.trial030.stdout: linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-13T20:03:24.919 INFO:teuthology.orchestra.run.trial030.stdout: linux-image-5.15.0-170-generic linux-modules-5.15.0-170-generic 2026-02-13T20:03:24.920 INFO:teuthology.orchestra.run.trial030.stdout: linux-modules-extra-5.15.0-170-generic 2026-02-13T20:03:24.920 INFO:teuthology.orchestra.run.trial030.stdout:The following packages will be upgraded: 2026-02-13T20:03:24.920 INFO:teuthology.orchestra.run.trial030.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-13T20:03:25.033 INFO:teuthology.orchestra.run.trial030.stdout:3 upgraded, 5 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T20:03:25.033 INFO:teuthology.orchestra.run.trial030.stdout:Need to get 113 MB of archives. 2026-02-13T20:03:25.033 INFO:teuthology.orchestra.run.trial030.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-13T20:03:25.033 INFO:teuthology.orchestra.run.trial030.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-170-generic amd64 5.15.0-170.180 [22.7 MB] 2026-02-13T20:03:25.203 INFO:teuthology.orchestra.run.trial030.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-170-generic amd64 5.15.0-170.180 [11.6 MB] 2026-02-13T20:03:25.252 INFO:teuthology.orchestra.run.trial030.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-170-generic amd64 5.15.0-170.180 [64.0 MB] 2026-02-13T20:03:25.490 INFO:teuthology.orchestra.run.trial030.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.170.159 [1654 B] 2026-02-13T20:03:25.491 INFO:teuthology.orchestra.run.trial030.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.170.159 [2474 B] 2026-02-13T20:03:25.491 INFO:teuthology.orchestra.run.trial030.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170 all 5.15.0-170.180 [12.4 MB] 2026-02-13T20:03:25.539 INFO:teuthology.orchestra.run.trial030.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170-generic amd64 5.15.0-170.180 [2828 kB] 2026-02-13T20:03:25.549 INFO:teuthology.orchestra.run.trial030.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.170.159 [2316 B] 2026-02-13T20:03:25.751 INFO:teuthology.orchestra.run.trial030.stdout:Fetched 113 MB in 1s (181 MB/s) 2026-02-13T20:03:25.771 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package linux-modules-5.15.0-170-generic. 2026-02-13T20:03:25.934 INFO:teuthology.orchestra.run.trial030.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 131954 files and directories currently installed.) 2026-02-13T20:03:25.936 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../0-linux-modules-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T20:03:25.937 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T20:03:26.295 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package linux-image-5.15.0-170-generic. 2026-02-13T20:03:26.302 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../1-linux-image-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T20:03:26.321 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T20:03:26.361 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-170-generic. 2026-02-13T20:03:26.368 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T20:03:26.368 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T20:03:27.469 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../3-linux-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T20:03:27.470 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking linux-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T20:03:27.493 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T20:03:27.493 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking linux-image-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T20:03:27.511 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package linux-headers-5.15.0-170. 2026-02-13T20:03:27.517 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../5-linux-headers-5.15.0-170_5.15.0-170.180_all.deb ... 2026-02-13T20:03:27.518 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-13T20:03:28.856 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package linux-headers-5.15.0-170-generic. 2026-02-13T20:03:28.867 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../6-linux-headers-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T20:03:28.868 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T20:03:29.465 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T20:03:29.466 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking linux-headers-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T20:03:29.491 INFO:teuthology.orchestra.run.trial030.stdout:Setting up linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-13T20:03:29.492 INFO:teuthology.orchestra.run.trial030.stdout:Setting up linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T20:03:29.494 INFO:teuthology.orchestra.run.trial030.stdout:Setting up linux-headers-generic (5.15.0.170.159) ... 2026-02-13T20:03:29.495 INFO:teuthology.orchestra.run.trial030.stdout:Setting up linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T20:03:30.262 INFO:teuthology.orchestra.run.trial030.stdout:Setting up linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T20:03:31.081 INFO:teuthology.orchestra.run.trial030.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-13T20:03:31.081 INFO:teuthology.orchestra.run.trial030.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-170-generic 2026-02-13T20:03:31.086 INFO:teuthology.orchestra.run.trial030.stdout:Setting up linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T20:03:31.878 INFO:teuthology.orchestra.run.trial030.stdout:Setting up linux-image-generic (5.15.0.170.159) ... 2026-02-13T20:03:31.879 INFO:teuthology.orchestra.run.trial030.stdout:Setting up linux-generic (5.15.0.170.159) ... 2026-02-13T20:03:31.880 INFO:teuthology.orchestra.run.trial030.stdout:Processing triggers for linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T20:03:31.885 INFO:teuthology.orchestra.run.trial030.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-13T20:03:31.885 INFO:teuthology.orchestra.run.trial030.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-170-generic 2026-02-13T20:03:38.945 INFO:teuthology.orchestra.run.trial030.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-13T20:03:45.546 INFO:teuthology.orchestra.run.trial030.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-13T20:03:45.546 INFO:teuthology.orchestra.run.trial030.stdout:Sourcing file `/etc/default/grub' 2026-02-13T20:03:45.565 INFO:teuthology.orchestra.run.trial030.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-13T20:03:45.566 INFO:teuthology.orchestra.run.trial030.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-13T20:03:45.568 INFO:teuthology.orchestra.run.trial030.stdout:Generating grub configuration file ... 2026-02-13T20:03:45.648 INFO:teuthology.orchestra.run.trial030.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-13T20:03:45.654 INFO:teuthology.orchestra.run.trial030.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-13T20:03:45.830 INFO:teuthology.orchestra.run.trial030.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-13T20:03:45.836 INFO:teuthology.orchestra.run.trial030.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-13T20:03:45.908 INFO:teuthology.orchestra.run.trial030.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-13T20:03:45.909 INFO:teuthology.orchestra.run.trial030.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-13T20:03:45.909 INFO:teuthology.orchestra.run.trial030.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-13T20:03:45.911 INFO:teuthology.orchestra.run.trial030.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T20:03:45.920 INFO:teuthology.orchestra.run.trial030.stdout:done 2026-02-13T20:03:46.326 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-13T20:03:46.326 INFO:teuthology.orchestra.run.trial030.stdout:Pending kernel upgrade! 2026-02-13T20:03:46.326 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-13T20:03:46.326 INFO:teuthology.orchestra.run.trial030.stdout:Running kernel version: 2026-02-13T20:03:46.327 INFO:teuthology.orchestra.run.trial030.stdout: 5.15.0-164-generic 2026-02-13T20:03:46.327 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-13T20:03:46.327 INFO:teuthology.orchestra.run.trial030.stdout:Diagnostics: 2026-02-13T20:03:46.327 INFO:teuthology.orchestra.run.trial030.stdout: The currently running kernel version is not the expected kernel version 5.15.0-170-generic. 2026-02-13T20:03:46.327 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-13T20:03:46.327 INFO:teuthology.orchestra.run.trial030.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-13T20:03:46.327 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-13T20:03:46.327 INFO:teuthology.orchestra.run.trial030.stdout:The processor microcode seems to be up-to-date. 2026-02-13T20:03:46.327 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-13T20:03:46.327 INFO:teuthology.orchestra.run.trial030.stdout:No services need to be restarted. 2026-02-13T20:03:46.327 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-13T20:03:46.327 INFO:teuthology.orchestra.run.trial030.stdout:No containers need to be restarted. 2026-02-13T20:03:46.328 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-13T20:03:46.328 INFO:teuthology.orchestra.run.trial030.stdout:No user sessions are running outdated binaries. 2026-02-13T20:03:46.328 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-13T20:03:46.328 INFO:teuthology.orchestra.run.trial030.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-13T20:03:46.982 DEBUG:teuthology.orchestra.run.trial030:> dpkg -s linux-image-generic 2026-02-13T20:03:46.993 INFO:teuthology.orchestra.run.trial030.stdout:Package: linux-image-generic 2026-02-13T20:03:46.993 INFO:teuthology.orchestra.run.trial030.stdout:Status: install ok installed 2026-02-13T20:03:46.993 INFO:teuthology.orchestra.run.trial030.stdout:Priority: optional 2026-02-13T20:03:46.993 INFO:teuthology.orchestra.run.trial030.stdout:Section: kernel 2026-02-13T20:03:46.993 INFO:teuthology.orchestra.run.trial030.stdout:Installed-Size: 21 2026-02-13T20:03:46.993 INFO:teuthology.orchestra.run.trial030.stdout:Maintainer: Ubuntu Kernel Team 2026-02-13T20:03:46.993 INFO:teuthology.orchestra.run.trial030.stdout:Architecture: amd64 2026-02-13T20:03:46.993 INFO:teuthology.orchestra.run.trial030.stdout:Source: linux-meta 2026-02-13T20:03:46.994 INFO:teuthology.orchestra.run.trial030.stdout:Version: 5.15.0.170.159 2026-02-13T20:03:46.994 INFO:teuthology.orchestra.run.trial030.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-13T20:03:46.994 INFO:teuthology.orchestra.run.trial030.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-13T20:03:46.994 INFO:teuthology.orchestra.run.trial030.stdout:Recommends: thermald 2026-02-13T20:03:46.994 INFO:teuthology.orchestra.run.trial030.stdout:Description: Generic Linux kernel image 2026-02-13T20:03:46.994 INFO:teuthology.orchestra.run.trial030.stdout: This package will always depend on the latest generic kernel image 2026-02-13T20:03:46.994 INFO:teuthology.orchestra.run.trial030.stdout: available. 2026-02-13T20:03:46.994 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-164-generic Expected: 5.15.0-170-generic 2026-02-13T20:03:46.995 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T20:03:46.995 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T20:03:46.995 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-13T20:03:46.995 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial030.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T20:03:46.995 DEBUG:teuthology.orchestra.run.trial030:> sudo apt-get clean 2026-02-13T20:03:47.081 DEBUG:teuthology.orchestra.run.trial030:> sudo apt-get update 2026-02-13T20:03:47.261 INFO:teuthology.orchestra.run.trial030.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T20:03:47.265 INFO:teuthology.orchestra.run.trial030.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-13T20:03:47.274 INFO:teuthology.orchestra.run.trial030.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-13T20:03:47.284 INFO:teuthology.orchestra.run.trial030.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-13T20:03:48.109 INFO:teuthology.orchestra.run.trial030.stdout:Reading package lists... 2026-02-13T20:03:48.124 DEBUG:teuthology.orchestra.run.trial030:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-13T20:03:48.158 INFO:teuthology.orchestra.run.trial030.stdout:Reading package lists... 2026-02-13T20:03:48.267 INFO:teuthology.orchestra.run.trial030.stdout:Building dependency tree... 2026-02-13T20:03:48.268 INFO:teuthology.orchestra.run.trial030.stdout:Reading state information... 2026-02-13T20:03:48.353 INFO:teuthology.orchestra.run.trial030.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-13T20:03:48.353 INFO:teuthology.orchestra.run.trial030.stdout:linux-image-generic set to manually installed. 2026-02-13T20:03:48.354 INFO:teuthology.orchestra.run.trial030.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T20:03:48.354 INFO:teuthology.orchestra.run.trial030.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T20:03:48.354 INFO:teuthology.orchestra.run.trial030.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T20:03:48.354 INFO:teuthology.orchestra.run.trial030.stdout: sg3-utils-udev 2026-02-13T20:03:48.354 INFO:teuthology.orchestra.run.trial030.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T20:03:48.373 INFO:teuthology.orchestra.run.trial030.stdout:0 upgraded, 0 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T20:03:48.375 DEBUG:teuthology.orchestra.run.trial030:> dpkg -s linux-image-generic 2026-02-13T20:03:48.425 INFO:teuthology.orchestra.run.trial030.stdout:Package: linux-image-generic 2026-02-13T20:03:48.425 INFO:teuthology.orchestra.run.trial030.stdout:Status: install ok installed 2026-02-13T20:03:48.426 INFO:teuthology.orchestra.run.trial030.stdout:Priority: optional 2026-02-13T20:03:48.426 INFO:teuthology.orchestra.run.trial030.stdout:Section: kernel 2026-02-13T20:03:48.426 INFO:teuthology.orchestra.run.trial030.stdout:Installed-Size: 21 2026-02-13T20:03:48.426 INFO:teuthology.orchestra.run.trial030.stdout:Maintainer: Ubuntu Kernel Team 2026-02-13T20:03:48.426 INFO:teuthology.orchestra.run.trial030.stdout:Architecture: amd64 2026-02-13T20:03:48.426 INFO:teuthology.orchestra.run.trial030.stdout:Source: linux-meta 2026-02-13T20:03:48.426 INFO:teuthology.orchestra.run.trial030.stdout:Version: 5.15.0.170.159 2026-02-13T20:03:48.426 INFO:teuthology.orchestra.run.trial030.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-13T20:03:48.426 INFO:teuthology.orchestra.run.trial030.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-13T20:03:48.426 INFO:teuthology.orchestra.run.trial030.stdout:Recommends: thermald 2026-02-13T20:03:48.427 INFO:teuthology.orchestra.run.trial030.stdout:Description: Generic Linux kernel image 2026-02-13T20:03:48.427 INFO:teuthology.orchestra.run.trial030.stdout: This package will always depend on the latest generic kernel image 2026-02-13T20:03:48.427 INFO:teuthology.orchestra.run.trial030.stdout: available. 2026-02-13T20:03:48.428 DEBUG:teuthology.orchestra.run.trial030:> mktemp 2026-02-13T20:03:48.472 INFO:teuthology.orchestra.run.trial030.stdout:/tmp/tmp.AHuIRWgjsJ 2026-02-13T20:03:48.473 DEBUG:teuthology.orchestra.run.trial030:> sudo cp /boot/grub/grub.cfg /tmp/tmp.AHuIRWgjsJ 2026-02-13T20:03:48.525 DEBUG:teuthology.orchestra.run.trial030:> sudo chmod 0666 /tmp/tmp.AHuIRWgjsJ 2026-02-13T20:03:48.623 DEBUG:teuthology.orchestra.remote:trial030:/tmp/tmp.AHuIRWgjsJ is 7KB 2026-02-13T20:03:48.631 DEBUG:teuthology.orchestra.run.trial030:> rm -fr /tmp/tmp.AHuIRWgjsJ 2026-02-13T20:03:48.635 DEBUG:teuthology.orchestra.run.trial030:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-13T20:03:48.684 DEBUG:teuthology.orchestra.run.trial030:> set -ex 2026-02-13T20:03:48.684 DEBUG:teuthology.orchestra.run.trial030:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-13T20:03:48.684 DEBUG:teuthology.orchestra.run.trial030:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-13T20:03:48.738 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-170-generic 2026-02-13T20:03:48.739 DEBUG:teuthology.orchestra.run.trial030:> sudo update-grub 2026-02-13T20:03:48.979 INFO:teuthology.orchestra.run.trial030.stderr:Sourcing file `/etc/default/grub' 2026-02-13T20:03:48.997 INFO:teuthology.orchestra.run.trial030.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-13T20:03:48.998 INFO:teuthology.orchestra.run.trial030.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-13T20:03:49.000 INFO:teuthology.orchestra.run.trial030.stderr:Generating grub configuration file ... 2026-02-13T20:03:49.085 INFO:teuthology.orchestra.run.trial030.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-13T20:03:49.091 INFO:teuthology.orchestra.run.trial030.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-13T20:03:49.263 INFO:teuthology.orchestra.run.trial030.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-13T20:03:49.269 INFO:teuthology.orchestra.run.trial030.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-13T20:03:49.338 INFO:teuthology.orchestra.run.trial030.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-13T20:03:49.338 INFO:teuthology.orchestra.run.trial030.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-13T20:03:49.338 INFO:teuthology.orchestra.run.trial030.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-13T20:03:49.339 INFO:teuthology.orchestra.run.trial030.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T20:03:49.347 INFO:teuthology.orchestra.run.trial030.stderr:done 2026-02-13T20:03:49.348 DEBUG:teuthology.orchestra.run.trial030:> sudo shutdown -r now 2026-02-13T20:04:19.382 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-13T20:04:19.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial030.front.sepia.ceph.com' 2026-02-13T20:04:19.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial030.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T20:04:33.693 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.30 2026-02-13T20:04:42.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial030.front.sepia.ceph.com' 2026-02-13T20:04:42.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial030.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T20:05:18.748 DEBUG:teuthology.orchestra.run.trial030:> true 2026-02-13T20:05:19.159 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial030.front.sepia.ceph.com' 2026-02-13T20:05:19.159 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-170-generic"... 2026-02-13T20:05:19.159 DEBUG:teuthology.orchestra.run.trial030:> uname -r 2026-02-13T20:05:19.208 INFO:teuthology.orchestra.run.trial030.stdout:5.15.0-170-generic 2026-02-13T20:05:19.209 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-170-generic vs 5.15.0-170-generic 2026-02-13T20:05:19.209 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T20:05:19.209 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-13T20:05:20.210 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-13T20:05:20.211 DEBUG:teuthology.orchestra.run.trial030:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-13T20:05:20.223 INFO:teuthology.orchestra.run.trial030.stdout:ttyS1 2026-02-13T20:05:20.247 DEBUG:teuthology.parallel:result is None 2026-02-13T20:05:20.247 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-13T20:05:20.261 INFO:teuthology.task.internal:Creating test directory... 2026-02-13T20:05:20.261 DEBUG:teuthology.orchestra.run.trial030:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T20:05:20.293 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-13T20:05:20.309 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-13T20:05:20.321 INFO:teuthology.task.internal:Creating archive directory... 2026-02-13T20:05:20.321 DEBUG:teuthology.orchestra.run.trial030:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T20:05:20.346 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-13T20:05:20.358 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-13T20:05:20.359 DEBUG:teuthology.orchestra.run.trial030:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T20:05:20.393 INFO:teuthology.orchestra.run.trial030.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:05:20.400 INFO:teuthology.orchestra.run.trial030.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:05:20.401 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-13T20:05:20.413 INFO:teuthology.task.internal:Configuring sudo... 2026-02-13T20:05:20.413 DEBUG:teuthology.orchestra.run.trial030:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T20:05:20.457 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-13T20:05:20.473 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-13T20:05:20.474 DEBUG:teuthology.orchestra.run.trial030:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T20:05:20.504 DEBUG:teuthology.orchestra.run.trial030:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T20:05:20.549 DEBUG:teuthology.orchestra.run.trial030:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T20:05:20.596 DEBUG:teuthology.orchestra.run.trial030:> set -ex 2026-02-13T20:05:20.597 DEBUG:teuthology.orchestra.run.trial030:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T20:05:20.644 DEBUG:teuthology.orchestra.run.trial030:> sudo service rsyslog restart 2026-02-13T20:05:20.701 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-13T20:05:20.713 INFO:teuthology.task.internal:Starting timer... 2026-02-13T20:05:20.713 INFO:teuthology.run_tasks:Running task pcp... 2026-02-13T20:05:20.737 INFO:teuthology.run_tasks:Running task selinux... 2026-02-13T20:05:20.757 DEBUG:teuthology.task.selinux:Excluding trial030: OS 'ubuntu' does not support SELinux 2026-02-13T20:05:20.757 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-13T20:05:20.757 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-13T20:05:20.758 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-13T20:05:20.758 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-13T20:05:20.773 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-13T20:05:20.784 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-13T20:05:20.785 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial030.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-13T20:07:46.174 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial030.front.sepia.ceph.com')] 2026-02-13T20:07:46.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial030.front.sepia.ceph.com' 2026-02-13T20:07:46.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial030.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T20:07:46.291 DEBUG:teuthology.orchestra.run.trial030:> true 2026-02-13T20:07:46.541 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial030.front.sepia.ceph.com' 2026-02-13T20:07:46.542 INFO:teuthology.run_tasks:Running task clock... 2026-02-13T20:07:46.555 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-13T20:07:46.555 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T20:07:46.555 DEBUG:teuthology.orchestra.run.trial030:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T20:07:46.598 INFO:teuthology.orchestra.run.trial030.stdout:13 Feb 20:07:45 ntpd[8794]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-13T20:07:46.599 INFO:teuthology.orchestra.run.trial030.stdout:13 Feb 20:07:45 ntpd[8794]: Command line: ntpd -gq 2026-02-13T20:07:46.599 INFO:teuthology.orchestra.run.trial030.stdout:13 Feb 20:07:45 ntpd[8794]: ---------------------------------------------------- 2026-02-13T20:07:46.599 INFO:teuthology.orchestra.run.trial030.stdout:13 Feb 20:07:45 ntpd[8794]: ntp-4 is maintained by Network Time Foundation, 2026-02-13T20:07:46.599 INFO:teuthology.orchestra.run.trial030.stdout:13 Feb 20:07:45 ntpd[8794]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-13T20:07:46.599 INFO:teuthology.orchestra.run.trial030.stdout:13 Feb 20:07:45 ntpd[8794]: corporation. Support and training for ntp-4 are 2026-02-13T20:07:46.599 INFO:teuthology.orchestra.run.trial030.stdout:13 Feb 20:07:45 ntpd[8794]: available at https://www.nwtime.org/support 2026-02-13T20:07:46.599 INFO:teuthology.orchestra.run.trial030.stdout:13 Feb 20:07:45 ntpd[8794]: ---------------------------------------------------- 2026-02-13T20:07:46.600 INFO:teuthology.orchestra.run.trial030.stdout:13 Feb 20:07:45 ntpd[8794]: proto: precision = 0.020 usec (-25) 2026-02-13T20:07:46.600 INFO:teuthology.orchestra.run.trial030.stdout:13 Feb 20:07:45 ntpd[8794]: basedate set to 2022-02-04 2026-02-13T20:07:46.600 INFO:teuthology.orchestra.run.trial030.stdout:13 Feb 20:07:45 ntpd[8794]: gps base set to 2022-02-06 (week 2196) 2026-02-13T20:07:46.600 INFO:teuthology.orchestra.run.trial030.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-13T20:07:46.600 INFO:teuthology.orchestra.run.trial030.stdout:13 Feb 20:07:45 ntpd[8794]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-13T20:07:46.601 INFO:teuthology.orchestra.run.trial030.stdout:13 Feb 20:07:45 ntpd[8794]: restrict ::: KOD does nothing without LIMITED. 2026-02-13T20:07:46.601 INFO:teuthology.orchestra.run.trial030.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-13T20:07:46.601 INFO:teuthology.orchestra.run.trial030.stdout:13 Feb 20:07:45 ntpd[8794]: Listen and drop on 0 v6wildcard [::]:123 2026-02-13T20:07:46.602 INFO:teuthology.orchestra.run.trial030.stdout:13 Feb 20:07:45 ntpd[8794]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-13T20:07:46.602 INFO:teuthology.orchestra.run.trial030.stdout:13 Feb 20:07:45 ntpd[8794]: Listen normally on 2 lo 127.0.0.1:123 2026-02-13T20:07:46.602 INFO:teuthology.orchestra.run.trial030.stdout:13 Feb 20:07:45 ntpd[8794]: Listen normally on 3 enp1s0f0 10.20.193.30:123 2026-02-13T20:07:46.602 INFO:teuthology.orchestra.run.trial030.stdout:13 Feb 20:07:45 ntpd[8794]: Listen normally on 4 lo [::1]:123 2026-02-13T20:07:46.602 INFO:teuthology.orchestra.run.trial030.stdout:13 Feb 20:07:45 ntpd[8794]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe76:e844%2]:123 2026-02-13T20:07:46.602 INFO:teuthology.orchestra.run.trial030.stdout:13 Feb 20:07:45 ntpd[8794]: Listening on routing socket on fd #22 for interface updates 2026-02-13T20:07:47.599 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:46 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:47.599 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:46 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:47.664 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:47 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:47.665 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:47 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:47.665 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:47 ntpd[8794]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T20:07:47.665 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:47 ntpd[8794]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T20:07:48.599 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:47 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:48.599 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:47 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:48.599 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:47 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:48.599 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:47 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:48.606 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:47 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:48.607 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:47 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:48.607 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:47 ntpd[8794]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T20:07:48.607 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:47 ntpd[8794]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T20:07:48.626 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:47 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:48.626 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:47 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:48.626 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:47 ntpd[8794]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T20:07:48.626 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:47 ntpd[8794]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T20:07:49.598 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:48 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:49.599 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:48 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:49.663 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:49 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:49.664 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:49 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:49.664 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:49 ntpd[8794]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T20:07:49.664 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:49 ntpd[8794]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T20:07:50.598 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:49 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:50.599 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:49 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:50.599 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:49 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:50.599 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:49 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:50.606 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:49 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:50.606 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:49 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:50.606 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:49 ntpd[8794]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T20:07:50.606 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:49 ntpd[8794]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T20:07:50.626 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:49 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:50.626 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:49 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:50.626 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:49 ntpd[8794]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T20:07:50.626 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:49 ntpd[8794]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T20:07:51.599 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:50 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:51.599 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:50 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:51.599 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:50 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:51.599 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:50 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:51.625 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:50 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:51.626 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:50 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:51.626 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:50 ntpd[8794]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T20:07:51.626 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:50 ntpd[8794]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T20:07:51.663 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:51 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:51.663 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:51 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:51.663 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:51 ntpd[8794]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T20:07:51.664 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:51 ntpd[8794]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T20:07:52.599 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:51 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:52.599 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:51 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:52.599 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:51 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:52.600 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:51 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:52.606 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:51 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:52.606 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:51 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:52.606 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:51 ntpd[8794]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T20:07:52.606 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:51 ntpd[8794]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T20:07:52.626 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:51 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:52.627 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:51 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:52.627 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:51 ntpd[8794]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T20:07:52.627 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:51 ntpd[8794]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T20:07:53.599 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:52 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:53.600 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:52 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:53.600 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:52 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:53.600 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:52 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:53.625 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:52 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:53.625 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:52 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:53.625 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:52 ntpd[8794]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T20:07:53.625 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:52 ntpd[8794]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T20:07:53.663 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:53 ntpd[8794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T20:07:53.663 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:53 ntpd[8794]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T20:07:53.663 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:53 ntpd[8794]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T20:07:53.663 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:53 ntpd[8794]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T20:07:53.663 INFO:teuthology.orchestra.run.trial030.stdout:13 Feb 20:07:53 ntpd[8794]: ntpd: time set +0.659667 s 2026-02-13T20:07:53.664 INFO:teuthology.orchestra.run.trial030.stdout:ntpd: time set +0.659667s 2026-02-13T20:07:53.664 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:53 ntpd[8794]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-13T20:07:53.664 INFO:teuthology.orchestra.run.trial030.stderr:13 Feb 20:07:53 ntpd[8794]: can't open /var/log/ntpstats/loopstats.20260213: Permission denied 2026-02-13T20:07:53.686 INFO:teuthology.orchestra.run.trial030.stdout:No association ID's returned 2026-02-13T20:07:53.687 INFO:teuthology.run_tasks:Running task install... 2026-02-13T20:07:53.699 DEBUG:teuthology.task.install:project ceph 2026-02-13T20:07:53.699 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}} 2026-02-13T20:07:53.699 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'} 2026-02-13T20:07:53.699 INFO:teuthology.task.install:Using flavor: default 2026-02-13T20:07:53.702 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-13T20:07:53.702 INFO:teuthology.task.install:extra packages: [] 2026-02-13T20:07:53.702 DEBUG:teuthology.orchestra.run.trial030:> sudo apt-key list | grep Ceph 2026-02-13T20:07:53.780 INFO:teuthology.orchestra.run.trial030.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-13T20:07:53.804 INFO:teuthology.orchestra.run.trial030.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-13T20:07:53.804 INFO:teuthology.orchestra.run.trial030.stdout:uid [ unknown] Ceph.com (release key) 2026-02-13T20:07:53.805 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-osd, ceph-osd-classic, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-13T20:07:53.805 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-13T20:07:53.990 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default/ 2026-02-13T20:07:53.990 INFO:teuthology.task.install.deb:Package version is 20.3.0-5230-gafefaa40-1jammy 2026-02-13T20:07:54.324 DEBUG:teuthology.orchestra.run.trial030:> set -ex 2026-02-13T20:07:54.324 DEBUG:teuthology.orchestra.run.trial030:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-13T20:07:54.335 DEBUG:teuthology.orchestra.run.trial030:> sudo apt-get update 2026-02-13T20:07:54.526 INFO:teuthology.orchestra.run.trial030.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T20:07:54.530 INFO:teuthology.orchestra.run.trial030.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-13T20:07:54.540 INFO:teuthology.orchestra.run.trial030.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-13T20:07:54.549 INFO:teuthology.orchestra.run.trial030.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-13T20:07:54.645 INFO:teuthology.orchestra.run.trial030.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy InRelease 2026-02-13T20:07:54.695 INFO:teuthology.orchestra.run.trial030.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy Release [7689 B] 2026-02-13T20:07:54.745 INFO:teuthology.orchestra.run.trial030.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-13T20:07:54.795 INFO:teuthology.orchestra.run.trial030.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 Packages [19.2 kB] 2026-02-13T20:07:54.945 INFO:teuthology.orchestra.run.trial030.stdout:Fetched 26.9 kB in 0s (61.3 kB/s) 2026-02-13T20:07:55.483 INFO:teuthology.orchestra.run.trial030.stdout:Reading package lists... 2026-02-13T20:07:55.497 DEBUG:teuthology.orchestra.run.trial030:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.3.0-5230-gafefaa40-1jammy cephadm=20.3.0-5230-gafefaa40-1jammy ceph-mds=20.3.0-5230-gafefaa40-1jammy ceph-mgr=20.3.0-5230-gafefaa40-1jammy ceph-osd=20.3.0-5230-gafefaa40-1jammy ceph-osd-classic=20.3.0-5230-gafefaa40-1jammy ceph-common=20.3.0-5230-gafefaa40-1jammy ceph-fuse=20.3.0-5230-gafefaa40-1jammy ceph-test=20.3.0-5230-gafefaa40-1jammy ceph-volume=20.3.0-5230-gafefaa40-1jammy radosgw=20.3.0-5230-gafefaa40-1jammy python3-rados=20.3.0-5230-gafefaa40-1jammy python3-rgw=20.3.0-5230-gafefaa40-1jammy python3-cephfs=20.3.0-5230-gafefaa40-1jammy python3-rbd=20.3.0-5230-gafefaa40-1jammy libcephfs2=20.3.0-5230-gafefaa40-1jammy libcephfs-dev=20.3.0-5230-gafefaa40-1jammy librados2=20.3.0-5230-gafefaa40-1jammy librbd1=20.3.0-5230-gafefaa40-1jammy rbd-fuse=20.3.0-5230-gafefaa40-1jammy 2026-02-13T20:07:55.531 INFO:teuthology.orchestra.run.trial030.stdout:Reading package lists... 2026-02-13T20:07:55.639 INFO:teuthology.orchestra.run.trial030.stdout:Building dependency tree... 2026-02-13T20:07:55.639 INFO:teuthology.orchestra.run.trial030.stdout:Reading state information... 2026-02-13T20:07:55.729 INFO:teuthology.orchestra.run.trial030.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T20:07:55.729 INFO:teuthology.orchestra.run.trial030.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T20:07:55.729 INFO:teuthology.orchestra.run.trial030.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T20:07:55.729 INFO:teuthology.orchestra.run.trial030.stdout: sg3-utils-udev 2026-02-13T20:07:55.730 INFO:teuthology.orchestra.run.trial030.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T20:07:55.730 INFO:teuthology.orchestra.run.trial030.stdout:The following additional packages will be installed: 2026-02-13T20:07:55.730 INFO:teuthology.orchestra.run.trial030.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-13T20:07:55.730 INFO:teuthology.orchestra.run.trial030.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon jq libcephfs-daemon 2026-02-13T20:07:55.730 INFO:teuthology.orchestra.run.trial030.stdout: libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-13T20:07:55.730 INFO:teuthology.orchestra.run.trial030.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-13T20:07:55.730 INFO:teuthology.orchestra.run.trial030.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2026-02-13T20:07:55.730 INFO:teuthology.orchestra.run.trial030.stdout: nvme-cli python-asyncssh-doc python3-asyncssh python3-cachetools 2026-02-13T20:07:55.730 INFO:teuthology.orchestra.run.trial030.stdout: python3-ceph-argparse python3-ceph-common python3-cheroot python3-cherrypy3 2026-02-13T20:07:55.730 INFO:teuthology.orchestra.run.trial030.stdout: python3-google-auth python3-iniconfig python3-jaraco.classes 2026-02-13T20:07:55.730 INFO:teuthology.orchestra.run.trial030.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2026-02-13T20:07:55.730 INFO:teuthology.orchestra.run.trial030.stdout: python3-joblib python3-kubernetes python3-natsort python3-pluggy 2026-02-13T20:07:55.730 INFO:teuthology.orchestra.run.trial030.stdout: python3-portend python3-prettytable python3-psutil python3-py 2026-02-13T20:07:55.730 INFO:teuthology.orchestra.run.trial030.stdout: python3-pygments python3-pytest python3-repoze.lru python3-requests-oauthlib 2026-02-13T20:07:55.730 INFO:teuthology.orchestra.run.trial030.stdout: python3-routes python3-rsa python3-simplejson python3-sklearn 2026-02-13T20:07:55.730 INFO:teuthology.orchestra.run.trial030.stdout: python3-sklearn-lib python3-tempora python3-threadpoolctl python3-toml 2026-02-13T20:07:55.730 INFO:teuthology.orchestra.run.trial030.stdout: python3-wcwidth python3-webob python3-websocket python3-zc.lockfile 2026-02-13T20:07:55.730 INFO:teuthology.orchestra.run.trial030.stdout: qttranslations5-l10n socat xmlstarlet 2026-02-13T20:07:55.730 INFO:teuthology.orchestra.run.trial030.stdout:Suggested packages: 2026-02-13T20:07:55.731 INFO:teuthology.orchestra.run.trial030.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-13T20:07:55.731 INFO:teuthology.orchestra.run.trial030.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-13T20:07:55.731 INFO:teuthology.orchestra.run.trial030.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-13T20:07:55.731 INFO:teuthology.orchestra.run.trial030.stdout:Recommended packages: 2026-02-13T20:07:55.731 INFO:teuthology.orchestra.run.trial030.stdout: btrfs-tools 2026-02-13T20:07:55.764 INFO:teuthology.orchestra.run.trial030.stdout:The following NEW packages will be installed: 2026-02-13T20:07:55.765 INFO:teuthology.orchestra.run.trial030.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-13T20:07:55.765 INFO:teuthology.orchestra.run.trial030.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-13T20:07:55.765 INFO:teuthology.orchestra.run.trial030.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-osd-classic ceph-test 2026-02-13T20:07:55.765 INFO:teuthology.orchestra.run.trial030.stdout: ceph-volume cephadm jq libcephfs-daemon libcephfs-dev libcephfs-proxy2 2026-02-13T20:07:55.765 INFO:teuthology.orchestra.run.trial030.stdout: libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-13T20:07:55.765 INFO:teuthology.orchestra.run.trial030.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-13T20:07:55.765 INFO:teuthology.orchestra.run.trial030.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-13T20:07:55.765 INFO:teuthology.orchestra.run.trial030.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-13T20:07:55.765 INFO:teuthology.orchestra.run.trial030.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-13T20:07:55.765 INFO:teuthology.orchestra.run.trial030.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-13T20:07:55.765 INFO:teuthology.orchestra.run.trial030.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-13T20:07:55.765 INFO:teuthology.orchestra.run.trial030.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-natsort 2026-02-13T20:07:55.765 INFO:teuthology.orchestra.run.trial030.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2026-02-13T20:07:55.765 INFO:teuthology.orchestra.run.trial030.stdout: python3-pygments python3-pytest python3-rados python3-rbd python3-repoze.lru 2026-02-13T20:07:55.765 INFO:teuthology.orchestra.run.trial030.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2026-02-13T20:07:55.765 INFO:teuthology.orchestra.run.trial030.stdout: python3-simplejson python3-sklearn python3-sklearn-lib python3-tempora 2026-02-13T20:07:55.765 INFO:teuthology.orchestra.run.trial030.stdout: python3-threadpoolctl python3-toml python3-wcwidth python3-webob 2026-02-13T20:07:55.765 INFO:teuthology.orchestra.run.trial030.stdout: python3-websocket python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2026-02-13T20:07:55.765 INFO:teuthology.orchestra.run.trial030.stdout: socat xmlstarlet 2026-02-13T20:07:55.873 INFO:teuthology.orchestra.run.trial030.stdout:0 upgraded, 87 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T20:07:55.873 INFO:teuthology.orchestra.run.trial030.stdout:Need to get 701 MB of archives. 2026-02-13T20:07:55.873 INFO:teuthology.orchestra.run.trial030.stdout:After this operation, 2670 MB of additional disk space will be used. 2026-02-13T20:07:55.874 INFO:teuthology.orchestra.run.trial030.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-13T20:07:55.919 INFO:teuthology.orchestra.run.trial030.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-13T20:07:55.921 INFO:teuthology.orchestra.run.trial030.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-13T20:07:55.930 INFO:teuthology.orchestra.run.trial030.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-13T20:07:55.961 INFO:teuthology.orchestra.run.trial030.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-13T20:07:55.962 INFO:teuthology.orchestra.run.trial030.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-13T20:07:55.968 INFO:teuthology.orchestra.run.trial030.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-13T20:07:55.969 INFO:teuthology.orchestra.run.trial030.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-13T20:07:55.970 INFO:teuthology.orchestra.run.trial030.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-13T20:07:55.970 INFO:teuthology.orchestra.run.trial030.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-13T20:07:55.971 INFO:teuthology.orchestra.run.trial030.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-13T20:07:55.975 INFO:teuthology.orchestra.run.trial030.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-13T20:07:55.976 INFO:teuthology.orchestra.run.trial030.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-13T20:07:55.976 INFO:teuthology.orchestra.run.trial030.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-13T20:07:55.981 INFO:teuthology.orchestra.run.trial030.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-13T20:07:55.981 INFO:teuthology.orchestra.run.trial030.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-13T20:07:55.982 INFO:teuthology.orchestra.run.trial030.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-13T20:07:55.982 INFO:teuthology.orchestra.run.trial030.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-13T20:07:55.982 INFO:teuthology.orchestra.run.trial030.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-13T20:07:55.991 INFO:teuthology.orchestra.run.trial030.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-13T20:07:55.991 INFO:teuthology.orchestra.run.trial030.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-13T20:07:55.993 INFO:teuthology.orchestra.run.trial030.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-13T20:07:55.993 INFO:teuthology.orchestra.run.trial030.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-13T20:07:55.994 INFO:teuthology.orchestra.run.trial030.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-13T20:07:56.000 INFO:teuthology.orchestra.run.trial030.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-13T20:07:56.001 INFO:teuthology.orchestra.run.trial030.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-13T20:07:56.001 INFO:teuthology.orchestra.run.trial030.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-13T20:07:56.015 INFO:teuthology.orchestra.run.trial030.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-13T20:07:56.017 INFO:teuthology.orchestra.run.trial030.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-13T20:07:56.017 INFO:teuthology.orchestra.run.trial030.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-13T20:07:56.028 INFO:teuthology.orchestra.run.trial030.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-13T20:07:56.028 INFO:teuthology.orchestra.run.trial030.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-13T20:07:56.029 INFO:teuthology.orchestra.run.trial030.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-13T20:07:56.029 INFO:teuthology.orchestra.run.trial030.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-13T20:07:56.029 INFO:teuthology.orchestra.run.trial030.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-13T20:07:56.029 INFO:teuthology.orchestra.run.trial030.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-13T20:07:56.031 INFO:teuthology.orchestra.run.trial030.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-13T20:07:56.031 INFO:teuthology.orchestra.run.trial030.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-13T20:07:56.032 INFO:teuthology.orchestra.run.trial030.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-13T20:07:56.039 INFO:teuthology.orchestra.run.trial030.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-13T20:07:56.039 INFO:teuthology.orchestra.run.trial030.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.3.0-5230-gafefaa40-1jammy [3798 kB] 2026-02-13T20:07:56.041 INFO:teuthology.orchestra.run.trial030.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-13T20:07:56.043 INFO:teuthology.orchestra.run.trial030.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-13T20:07:56.048 INFO:teuthology.orchestra.run.trial030.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-13T20:07:56.050 INFO:teuthology.orchestra.run.trial030.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-13T20:07:56.050 INFO:teuthology.orchestra.run.trial030.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-13T20:07:56.050 INFO:teuthology.orchestra.run.trial030.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-13T20:07:56.051 INFO:teuthology.orchestra.run.trial030.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-13T20:07:56.051 INFO:teuthology.orchestra.run.trial030.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-13T20:07:56.054 INFO:teuthology.orchestra.run.trial030.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-13T20:07:56.057 INFO:teuthology.orchestra.run.trial030.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-13T20:07:56.059 INFO:teuthology.orchestra.run.trial030.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-13T20:07:56.059 INFO:teuthology.orchestra.run.trial030.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-13T20:07:56.067 INFO:teuthology.orchestra.run.trial030.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-13T20:07:56.553 INFO:teuthology.orchestra.run.trial030.stdout:Get:55 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.3.0-5230-gafefaa40-1jammy [2910 kB] 2026-02-13T20:07:56.702 INFO:teuthology.orchestra.run.trial030.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.3.0-5230-gafefaa40-1jammy [882 kB] 2026-02-13T20:07:56.765 INFO:teuthology.orchestra.run.trial030.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.3.0-5230-gafefaa40-1jammy [359 kB] 2026-02-13T20:07:56.770 INFO:teuthology.orchestra.run.trial030.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.3.0-5230-gafefaa40-1jammy [32.8 kB] 2026-02-13T20:07:56.771 INFO:teuthology.orchestra.run.trial030.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.3.0-5230-gafefaa40-1jammy [225 kB] 2026-02-13T20:07:56.775 INFO:teuthology.orchestra.run.trial030.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.3.0-5230-gafefaa40-1jammy [88.4 kB] 2026-02-13T20:07:56.776 INFO:teuthology.orchestra.run.trial030.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.3.0-5230-gafefaa40-1jammy [339 kB] 2026-02-13T20:07:56.792 INFO:teuthology.orchestra.run.trial030.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.3.0-5230-gafefaa40-1jammy [9083 kB] 2026-02-13T20:07:57.162 INFO:teuthology.orchestra.run.trial030.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.3.0-5230-gafefaa40-1jammy [112 kB] 2026-02-13T20:07:57.163 INFO:teuthology.orchestra.run.trial030.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.3.0-5230-gafefaa40-1jammy [261 kB] 2026-02-13T20:07:57.168 INFO:teuthology.orchestra.run.trial030.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.3.0-5230-gafefaa40-1jammy [31.5 MB] 2026-02-13T20:07:58.088 INFO:teuthology.orchestra.run.trial030.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.3.0-5230-gafefaa40-1jammy [4982 kB] 2026-02-13T20:07:58.259 INFO:teuthology.orchestra.run.trial030.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.3.0-5230-gafefaa40-1jammy [293 kB] 2026-02-13T20:07:58.272 INFO:teuthology.orchestra.run.trial030.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.3.0-5230-gafefaa40-1jammy [127 kB] 2026-02-13T20:07:58.274 INFO:teuthology.orchestra.run.trial030.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.3.0-5230-gafefaa40-1jammy [922 kB] 2026-02-13T20:07:58.305 INFO:teuthology.orchestra.run.trial030.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.3.0-5230-gafefaa40-1jammy [7542 kB] 2026-02-13T20:07:58.574 INFO:teuthology.orchestra.run.trial030.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-classic amd64 20.3.0-5230-gafefaa40-1jammy [468 MB] 2026-02-13T20:08:08.637 INFO:teuthology.orchestra.run.trial030.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.3.0-5230-gafefaa40-1jammy [180 kB] 2026-02-13T20:08:08.638 INFO:teuthology.orchestra.run.trial030.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.3.0-5230-gafefaa40-1jammy [14.0 kB] 2026-02-13T20:08:08.638 INFO:teuthology.orchestra.run.trial030.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.3.0-5230-gafefaa40-1jammy [1030 kB] 2026-02-13T20:08:08.643 INFO:teuthology.orchestra.run.trial030.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.3.0-5230-gafefaa40-1jammy [2438 kB] 2026-02-13T20:08:08.655 INFO:teuthology.orchestra.run.trial030.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.3.0-5230-gafefaa40-1jammy [1068 kB] 2026-02-13T20:08:08.661 INFO:teuthology.orchestra.run.trial030.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.3.0-5230-gafefaa40-1jammy [190 kB] 2026-02-13T20:08:08.662 INFO:teuthology.orchestra.run.trial030.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.3.0-5230-gafefaa40-1jammy [54.5 MB] 2026-02-13T20:08:09.551 INFO:teuthology.orchestra.run.trial030.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.3.0-5230-gafefaa40-1jammy [8626 kB] 2026-02-13T20:08:09.684 INFO:teuthology.orchestra.run.trial030.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.3.0-5230-gafefaa40-1jammy [14.2 kB] 2026-02-13T20:08:09.685 INFO:teuthology.orchestra.run.trial030.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.3.0-5230-gafefaa40-1jammy [68.6 MB] 2026-02-13T20:08:10.819 INFO:teuthology.orchestra.run.trial030.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.3.0-5230-gafefaa40-1jammy [136 kB] 2026-02-13T20:08:10.820 INFO:teuthology.orchestra.run.trial030.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.3.0-5230-gafefaa40-1jammy [45.1 kB] 2026-02-13T20:08:10.820 INFO:teuthology.orchestra.run.trial030.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.3.0-5230-gafefaa40-1jammy [31.7 kB] 2026-02-13T20:08:10.820 INFO:teuthology.orchestra.run.trial030.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.3.0-5230-gafefaa40-1jammy [44.2 kB] 2026-02-13T20:08:10.821 INFO:teuthology.orchestra.run.trial030.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.3.0-5230-gafefaa40-1jammy [18.3 MB] 2026-02-13T20:08:11.114 INFO:teuthology.orchestra.run.trial030.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.3.0-5230-gafefaa40-1jammy [93.5 kB] 2026-02-13T20:08:11.400 INFO:teuthology.orchestra.run.trial030.stdout:Fetched 701 MB in 15s (45.7 MB/s) 2026-02-13T20:08:11.417 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-13T20:08:11.574 INFO:teuthology.orchestra.run.trial030.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167438 files and directories currently installed.) 2026-02-13T20:08:11.575 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../00-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-13T20:08:11.576 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-13T20:08:11.598 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-13T20:08:11.610 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../01-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-13T20:08:11.611 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-13T20:08:11.628 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-13T20:08:11.640 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../02-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-13T20:08:11.640 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-13T20:08:11.660 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-13T20:08:11.668 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../03-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T20:08:11.673 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T20:08:11.705 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-13T20:08:11.714 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../04-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T20:08:11.714 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T20:08:11.730 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-13T20:08:11.738 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../05-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T20:08:11.739 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T20:08:11.759 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-13T20:08:11.767 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../06-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-13T20:08:11.768 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-13T20:08:11.784 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package librados2. 2026-02-13T20:08:11.792 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../07-librados2_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:11.793 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking librados2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:11.836 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libnbd0. 2026-02-13T20:08:11.844 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../08-libnbd0_1.10.5-1_amd64.deb ... 2026-02-13T20:08:11.844 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-13T20:08:11.859 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package librbd1. 2026-02-13T20:08:11.867 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../09-librbd1_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:11.868 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking librbd1 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:11.904 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libcephfs2. 2026-02-13T20:08:11.912 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../10-libcephfs2_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:11.912 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libcephfs2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:11.933 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-rados. 2026-02-13T20:08:11.941 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../11-python3-rados_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:11.941 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-rados (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:11.959 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-13T20:08:11.967 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../12-python3-ceph-argparse_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T20:08:11.967 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-ceph-argparse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:11.980 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-cephfs. 2026-02-13T20:08:11.988 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../13-python3-cephfs_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:11.989 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-cephfs (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:12.005 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-13T20:08:12.013 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../14-python3-ceph-common_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T20:08:12.014 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-ceph-common (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:12.032 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-13T20:08:12.040 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../15-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-13T20:08:12.040 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-13T20:08:12.055 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-prettytable. 2026-02-13T20:08:12.064 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../16-python3-prettytable_2.5.0-2_all.deb ... 2026-02-13T20:08:12.064 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-13T20:08:12.078 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-rbd. 2026-02-13T20:08:12.086 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../17-python3-rbd_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:12.087 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-rbd (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:12.104 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-13T20:08:12.111 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../18-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-13T20:08:12.112 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-13T20:08:12.130 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package librgw2. 2026-02-13T20:08:12.138 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../19-librgw2_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:12.139 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking librgw2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:12.236 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-rgw. 2026-02-13T20:08:12.244 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../20-python3-rgw_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:12.245 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-rgw (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:12.259 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-13T20:08:12.267 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../21-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-13T20:08:12.268 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-13T20:08:12.283 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libradosstriper1. 2026-02-13T20:08:12.291 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../22-libradosstriper1_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:12.292 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libradosstriper1 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:12.309 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-common. 2026-02-13T20:08:12.316 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../23-ceph-common_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:12.316 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-common (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:12.578 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-base. 2026-02-13T20:08:12.587 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../24-ceph-base_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:12.591 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-base (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:12.648 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-13T20:08:12.657 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../25-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-13T20:08:12.657 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-13T20:08:12.671 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-cheroot. 2026-02-13T20:08:12.679 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../26-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-13T20:08:12.680 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-13T20:08:12.696 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-13T20:08:12.704 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../27-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-13T20:08:12.705 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-13T20:08:12.720 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-13T20:08:12.728 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../28-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-13T20:08:12.729 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-13T20:08:12.742 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-13T20:08:12.750 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../29-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-13T20:08:12.750 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-13T20:08:12.765 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-tempora. 2026-02-13T20:08:12.773 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../30-python3-tempora_4.1.2-1_all.deb ... 2026-02-13T20:08:12.773 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-13T20:08:12.787 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-portend. 2026-02-13T20:08:12.795 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../31-python3-portend_3.0.0-1_all.deb ... 2026-02-13T20:08:12.796 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-13T20:08:12.810 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-13T20:08:12.818 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../32-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-13T20:08:12.818 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-13T20:08:12.833 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-13T20:08:12.841 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../33-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-13T20:08:12.841 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-13T20:08:12.864 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-natsort. 2026-02-13T20:08:12.872 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../34-python3-natsort_8.0.2-1_all.deb ... 2026-02-13T20:08:12.873 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-13T20:08:12.888 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-13T20:08:12.896 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../35-ceph-mgr-modules-core_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T20:08:12.897 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-mgr-modules-core (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:12.927 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-13T20:08:12.935 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../36-libsqlite3-mod-ceph_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:12.935 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libsqlite3-mod-ceph (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:12.951 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-mgr. 2026-02-13T20:08:12.959 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../37-ceph-mgr_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:12.960 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-mgr (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:12.980 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-mon. 2026-02-13T20:08:12.988 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../38-ceph-mon_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:12.989 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-mon (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:13.054 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-13T20:08:13.062 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../39-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-13T20:08:13.063 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-13T20:08:13.078 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-osd-classic. 2026-02-13T20:08:13.086 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../40-ceph-osd-classic_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:13.086 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-osd-classic (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:16.968 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-osd. 2026-02-13T20:08:16.980 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../41-ceph-osd_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:16.981 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-osd (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:17.001 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph. 2026-02-13T20:08:17.014 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../42-ceph_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:17.014 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:17.030 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-fuse. 2026-02-13T20:08:17.042 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../43-ceph-fuse_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:17.043 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-fuse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:17.066 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-mds. 2026-02-13T20:08:17.077 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../44-ceph-mds_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:17.077 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-mds (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:17.109 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package cephadm. 2026-02-13T20:08:17.117 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../45-cephadm_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:17.117 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking cephadm (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:17.133 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-13T20:08:17.142 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../46-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-13T20:08:17.142 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-13T20:08:17.164 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-13T20:08:17.172 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../47-ceph-mgr-cephadm_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T20:08:17.172 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-mgr-cephadm (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:17.194 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-13T20:08:17.202 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../48-python3-repoze.lru_0.7-2_all.deb ... 2026-02-13T20:08:17.202 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-13T20:08:17.217 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-routes. 2026-02-13T20:08:17.225 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../49-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-13T20:08:17.225 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-13T20:08:17.245 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-13T20:08:17.253 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../50-ceph-mgr-dashboard_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T20:08:17.253 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-mgr-dashboard (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:17.939 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-13T20:08:17.948 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../51-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-13T20:08:17.948 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-13T20:08:17.987 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-joblib. 2026-02-13T20:08:17.996 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../52-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-13T20:08:17.996 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-13T20:08:18.026 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-13T20:08:18.034 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../53-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-13T20:08:18.035 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-13T20:08:18.049 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-sklearn. 2026-02-13T20:08:18.057 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../54-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-13T20:08:18.058 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-13T20:08:18.141 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-13T20:08:18.150 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../55-ceph-mgr-diskprediction-local_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T20:08:18.151 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-mgr-diskprediction-local (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:18.308 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-cachetools. 2026-02-13T20:08:18.316 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../56-python3-cachetools_5.0.0-1_all.deb ... 2026-02-13T20:08:18.317 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-13T20:08:18.332 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-rsa. 2026-02-13T20:08:18.340 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../57-python3-rsa_4.8-1_all.deb ... 2026-02-13T20:08:18.340 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-13T20:08:18.359 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-google-auth. 2026-02-13T20:08:18.367 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../58-python3-google-auth_1.5.1-3_all.deb ... 2026-02-13T20:08:18.368 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-13T20:08:18.385 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-13T20:08:18.393 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../59-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-13T20:08:18.394 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-13T20:08:18.409 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-websocket. 2026-02-13T20:08:18.417 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../60-python3-websocket_1.2.3-1_all.deb ... 2026-02-13T20:08:18.418 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-13T20:08:18.435 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-13T20:08:18.443 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../61-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-13T20:08:18.443 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-13T20:08:18.534 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-13T20:08:18.543 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../62-ceph-mgr-k8sevents_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T20:08:18.544 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-mgr-k8sevents (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:18.558 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-13T20:08:18.566 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../63-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-13T20:08:18.567 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-13T20:08:18.582 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-13T20:08:18.591 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../64-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-13T20:08:18.591 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-13T20:08:18.606 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package jq. 2026-02-13T20:08:18.614 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../65-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-13T20:08:18.615 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-13T20:08:18.629 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package socat. 2026-02-13T20:08:18.637 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../66-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-13T20:08:18.638 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-13T20:08:18.659 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package xmlstarlet. 2026-02-13T20:08:18.667 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../67-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-13T20:08:18.668 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-13T20:08:18.703 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-test. 2026-02-13T20:08:18.711 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../68-ceph-test_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:18.712 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-test (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:19.354 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-volume. 2026-02-13T20:08:19.363 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../69-ceph-volume_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T20:08:19.363 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-volume (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:19.387 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-13T20:08:19.396 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../70-libcephfs-daemon_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:19.396 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libcephfs-daemon (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:19.411 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-13T20:08:19.419 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../71-libcephfs-proxy2_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:19.419 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libcephfs-proxy2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:19.433 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-13T20:08:19.442 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../72-libcephfs-dev_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:19.442 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libcephfs-dev (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:19.459 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package nvme-cli. 2026-02-13T20:08:19.467 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../73-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-13T20:08:19.468 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-13T20:08:19.498 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-13T20:08:19.507 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../74-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-13T20:08:19.507 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-13T20:08:19.537 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-13T20:08:19.546 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../75-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-13T20:08:19.546 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-13T20:08:19.560 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-pluggy. 2026-02-13T20:08:19.569 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../76-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-13T20:08:19.569 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-13T20:08:19.584 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-psutil. 2026-02-13T20:08:19.593 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../77-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-13T20:08:19.593 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-13T20:08:19.612 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-py. 2026-02-13T20:08:19.620 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../78-python3-py_1.10.0-1_all.deb ... 2026-02-13T20:08:19.621 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-13T20:08:19.641 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-pygments. 2026-02-13T20:08:19.650 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../79-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-13T20:08:19.650 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-13T20:08:19.691 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-toml. 2026-02-13T20:08:19.700 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../80-python3-toml_0.10.2-1_all.deb ... 2026-02-13T20:08:19.700 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-13T20:08:19.715 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-pytest. 2026-02-13T20:08:19.724 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../81-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-13T20:08:19.724 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-13T20:08:19.745 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-simplejson. 2026-02-13T20:08:19.754 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../82-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-13T20:08:19.755 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-13T20:08:19.780 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-webob. 2026-02-13T20:08:19.789 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../83-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-13T20:08:19.789 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-13T20:08:19.806 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-13T20:08:19.815 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../84-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-13T20:08:19.815 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-13T20:08:19.884 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package radosgw. 2026-02-13T20:08:19.893 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../85-radosgw_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:19.894 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking radosgw (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:20.048 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package rbd-fuse. 2026-02-13T20:08:20.057 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../86-rbd-fuse_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T20:08:20.057 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking rbd-fuse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:20.084 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-13T20:08:20.150 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-13T20:08:20.151 INFO:teuthology.orchestra.run.trial030.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-13T20:08:20.222 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T20:08:20.531 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-13T20:08:20.918 INFO:teuthology.orchestra.run.trial030.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-13T20:08:20.928 INFO:teuthology.orchestra.run.trial030.stdout:Setting up cephadm (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:20.972 INFO:teuthology.orchestra.run.trial030.stdout:Adding system user cephadm....done 2026-02-13T20:08:20.977 INFO:teuthology.orchestra.run.trial030.stdout:usermod: no changes 2026-02-13T20:08:20.982 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-13T20:08:21.055 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-13T20:08:21.056 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-13T20:08:21.131 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-13T20:08:21.206 INFO:teuthology.orchestra.run.trial030.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-13T20:08:21.207 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-13T20:08:21.303 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-13T20:08:21.425 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-13T20:08:21.500 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-13T20:08:21.577 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-ceph-argparse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:21.641 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-13T20:08:21.642 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-13T20:08:21.643 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-13T20:08:21.644 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-13T20:08:21.645 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-13T20:08:21.768 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-13T20:08:21.845 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libcephfs-proxy2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:21.846 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-13T20:08:21.924 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-13T20:08:22.011 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-13T20:08:22.269 INFO:teuthology.orchestra.run.trial030.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-13T20:08:22.270 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-13T20:08:22.365 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-13T20:08:22.490 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-13T20:08:22.572 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-13T20:08:22.643 INFO:teuthology.orchestra.run.trial030.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-13T20:08:22.644 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-ceph-common (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:22.733 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-13T20:08:23.229 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T20:08:23.233 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-13T20:08:23.311 INFO:teuthology.orchestra.run.trial030.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-13T20:08:23.312 INFO:teuthology.orchestra.run.trial030.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-13T20:08:23.313 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-13T20:08:23.386 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-13T20:08:23.458 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T20:08:23.459 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-13T20:08:23.536 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-13T20:08:23.609 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-13T20:08:23.685 INFO:teuthology.orchestra.run.trial030.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-13T20:08:23.686 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-13T20:08:23.769 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-13T20:08:23.770 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-13T20:08:23.847 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-13T20:08:23.930 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-13T20:08:24.004 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-13T20:08:24.005 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-13T20:08:24.141 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-13T20:08:24.214 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T20:08:24.215 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-13T20:08:24.296 INFO:teuthology.orchestra.run.trial030.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-13T20:08:24.297 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-13T20:08:24.429 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-13T20:08:24.430 INFO:teuthology.orchestra.run.trial030.stdout:Setting up librados2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:24.431 INFO:teuthology.orchestra.run.trial030.stdout:Setting up librgw2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:24.432 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libsqlite3-mod-ceph (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:24.433 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-13T20:08:24.956 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libcephfs2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:24.957 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libradosstriper1 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:24.958 INFO:teuthology.orchestra.run.trial030.stdout:Setting up librbd1 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:24.959 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-mgr-modules-core (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:24.960 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-fuse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:25.031 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-13T20:08:25.031 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-13T20:08:25.445 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libcephfs-dev (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:25.446 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-rados (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:25.446 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libcephfs-daemon (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:25.447 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-rbd (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:25.448 INFO:teuthology.orchestra.run.trial030.stdout:Setting up rbd-fuse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:25.449 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-rgw (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:25.450 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-cephfs (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:25.451 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-common (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:25.480 INFO:teuthology.orchestra.run.trial030.stdout:Adding group ceph....done 2026-02-13T20:08:25.515 INFO:teuthology.orchestra.run.trial030.stdout:Adding system user ceph....done 2026-02-13T20:08:25.525 INFO:teuthology.orchestra.run.trial030.stdout:Setting system user ceph properties....done 2026-02-13T20:08:25.530 INFO:teuthology.orchestra.run.trial030.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-13T20:08:25.616 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-13T20:08:25.902 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-13T20:08:26.302 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-test (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:26.303 INFO:teuthology.orchestra.run.trial030.stdout:Setting up radosgw (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:26.567 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-13T20:08:26.568 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-13T20:08:26.956 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-base (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:27.075 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-13T20:08:27.462 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-mds (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:27.521 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-13T20:08:27.521 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-13T20:08:27.913 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-mgr (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:27.972 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-13T20:08:27.972 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-13T20:08:28.386 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-mgr-k8sevents (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:28.386 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-osd-classic (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:28.402 INFO:teuthology.orchestra.run.trial030.stdout:update-alternatives: using /usr/bin/ceph-osd-classic to provide /usr/bin/ceph-osd (ceph-osd) in auto mode 2026-02-13T20:08:28.412 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-mgr-diskprediction-local (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:28.423 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-mon (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:28.496 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-13T20:08:28.496 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-13T20:08:28.885 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-mgr-cephadm (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:28.895 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-mgr-dashboard (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:28.906 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-osd (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:28.978 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-13T20:08:28.978 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-13T20:08:29.400 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:29.401 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-volume (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T20:08:29.508 INFO:teuthology.orchestra.run.trial030.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-13T20:08:29.528 INFO:teuthology.orchestra.run.trial030.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-13T20:08:30.181 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-13T20:08:30.181 INFO:teuthology.orchestra.run.trial030.stdout:Running kernel seems to be up-to-date. 2026-02-13T20:08:30.181 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-13T20:08:30.181 INFO:teuthology.orchestra.run.trial030.stdout:The processor microcode seems to be up-to-date. 2026-02-13T20:08:30.181 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-13T20:08:30.181 INFO:teuthology.orchestra.run.trial030.stdout:No services need to be restarted. 2026-02-13T20:08:30.181 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-13T20:08:30.181 INFO:teuthology.orchestra.run.trial030.stdout:No containers need to be restarted. 2026-02-13T20:08:30.181 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-13T20:08:30.181 INFO:teuthology.orchestra.run.trial030.stdout:No user sessions are running outdated binaries. 2026-02-13T20:08:30.181 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-13T20:08:30.181 INFO:teuthology.orchestra.run.trial030.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-13T20:08:30.830 INFO:teuthology.orchestra.run.trial030.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-13T20:08:30.837 DEBUG:teuthology.parallel:result is None 2026-02-13T20:08:30.837 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-13T20:08:30.958 DEBUG:teuthology.orchestra.run.trial030:> dpkg-query -W -f '${Version}' ceph 2026-02-13T20:08:30.968 INFO:teuthology.orchestra.run.trial030.stdout:20.3.0-5230-gafefaa40-1jammy 2026-02-13T20:08:30.968 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5230-gafefaa40-1jammy 2026-02-13T20:08:30.969 INFO:teuthology.task.install:The correct ceph version 20.3.0-5230-gafefaa40-1jammy is installed. 2026-02-13T20:08:30.970 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-13T20:08:30.970 DEBUG:teuthology.orchestra.run.trial030:> set -ex 2026-02-13T20:08:30.970 DEBUG:teuthology.orchestra.run.trial030:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T20:08:31.018 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-13T20:08:31.018 DEBUG:teuthology.orchestra.run.trial030:> set -ex 2026-02-13T20:08:31.018 DEBUG:teuthology.orchestra.run.trial030:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T20:08:31.070 DEBUG:teuthology.orchestra.run.trial030:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T20:08:31.118 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-13T20:08:31.118 DEBUG:teuthology.orchestra.run.trial030:> set -ex 2026-02-13T20:08:31.118 DEBUG:teuthology.orchestra.run.trial030:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T20:08:31.165 DEBUG:teuthology.orchestra.run.trial030:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T20:08:31.213 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-13T20:08:31.214 DEBUG:teuthology.orchestra.run.trial030:> set -ex 2026-02-13T20:08:31.214 DEBUG:teuthology.orchestra.run.trial030:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T20:08:31.263 DEBUG:teuthology.orchestra.run.trial030:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T20:08:31.313 INFO:teuthology.run_tasks:Running task workunit... 2026-02-13T20:08:31.328 INFO:tasks.workunit:Pulling workunits from ref afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-13T20:08:31.328 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-13T20:08:31.328 INFO:tasks.workunit:timeout=3h 2026-02-13T20:08:31.328 INFO:tasks.workunit:cleanup=True 2026-02-13T20:08:31.329 DEBUG:teuthology.orchestra.run.trial030:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-13T20:08:31.357 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T20:08:31.357 INFO:teuthology.orchestra.run.trial030.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-13T20:08:31.357 DEBUG:teuthology.orchestra.run.trial030:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-13T20:08:31.401 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-13T20:08:31.401 DEBUG:teuthology.orchestra.run.trial030:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-13T20:08:31.445 DEBUG:teuthology.orchestra.run.trial030:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-13T20:08:31.496 INFO:tasks.workunit.client.0.trial030.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-13T20:08:53.476 INFO:tasks.workunit.client.0.trial030.stderr:Note: switching to 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'. 2026-02-13T20:08:53.476 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-13T20:08:53.476 INFO:tasks.workunit.client.0.trial030.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-13T20:08:53.476 INFO:tasks.workunit.client.0.trial030.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-13T20:08:53.476 INFO:tasks.workunit.client.0.trial030.stderr:state without impacting any branches by switching back to a branch. 2026-02-13T20:08:53.476 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-13T20:08:53.477 INFO:tasks.workunit.client.0.trial030.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-13T20:08:53.477 INFO:tasks.workunit.client.0.trial030.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-13T20:08:53.477 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-13T20:08:53.477 INFO:tasks.workunit.client.0.trial030.stderr: git switch -c 2026-02-13T20:08:53.477 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-13T20:08:53.477 INFO:tasks.workunit.client.0.trial030.stderr:Or undo this operation with: 2026-02-13T20:08:53.477 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-13T20:08:53.477 INFO:tasks.workunit.client.0.trial030.stderr: git switch - 2026-02-13T20:08:53.477 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-13T20:08:53.477 INFO:tasks.workunit.client.0.trial030.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-13T20:08:53.477 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-13T20:08:53.478 INFO:tasks.workunit.client.0.trial030.stderr:HEAD is now at afefaa40503 Merge branch 'block_non_4k_chunks' of https://github.com/aainscow/ceph into wip-yuri4-testing-2026-02-11-2126 2026-02-13T20:08:53.485 DEBUG:teuthology.orchestra.run.trial030:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-13T20:08:53.531 DEBUG:teuthology.orchestra.run.trial030:> set -ex 2026-02-13T20:08:53.531 DEBUG:teuthology.orchestra.run.trial030:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-13T20:08:53.577 INFO:tasks.workunit:Running workunits matching osd on client.0... 2026-02-13T20:08:53.578 INFO:tasks.workunit:Running workunit osd/bad-inc-map.sh... 2026-02-13T20:08:53.578 DEBUG:teuthology.orchestra.run.trial030:workunit test osd/bad-inc-map.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=afefaa40503a4bf024e96f97dd7f852b75f00ad6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh 2026-02-13T20:08:53.627 INFO:tasks.workunit.client.0.trial030.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-13T20:08:53.644 INFO:tasks.workunit.client.0.trial030.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-13T20:08:53.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-13T20:08:53.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-13T20:08:53.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-13T20:08:53.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-13T20:08:53.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-13T20:08:53.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-13T20:08:53.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-13T20:08:53.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-13T20:08:53.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/bad-inc-map 2026-02-13T20:08:53.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:8: run: local dir=td/bad-inc-map 2026-02-13T20:08:53.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:9: run: shift 2026-02-13T20:08:53.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: export CEPH_MON=127.0.0.1:55859 2026-02-13T20:08:53.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: CEPH_MON=127.0.0.1:55859 2026-02-13T20:08:53.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:12: run: export CEPH_ARGS 2026-02-13T20:08:53.644 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: uuidgen 2026-02-13T20:08:53.645 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: CEPH_ARGS+='--fsid=202de481-9bdb-4333-878c-6a5857968931 --auth-supported=none ' 2026-02-13T20:08:53.645 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:14: run: CEPH_ARGS+='--mon-host=127.0.0.1:55859 ' 2026-02-13T20:08:53.645 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:15: run: set -e 2026-02-13T20:08:53.646 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: set 2026-02-13T20:08:53.646 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-13T20:08:53.647 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: local funcs=TEST_bad_inc_map 2026-02-13T20:08:53.648 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:18: run: for func in $funcs 2026-02-13T20:08:53.648 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:19: run: setup td/bad-inc-map 2026-02-13T20:08:53.648 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/bad-inc-map 2026-02-13T20:08:53.648 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/bad-inc-map 2026-02-13T20:08:53.648 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-13T20:08:53.648 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T20:08:53.648 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-13T20:08:53.648 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:08:53.648 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:08:53.648 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:08:53.648 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:08:53.648 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:08:53.650 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:08:53.651 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T20:08:53.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T20:08:53.652 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T20:08:53.653 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T20:08:53.653 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T20:08:53.653 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T20:08:53.654 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:08:53.654 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T20:08:53.655 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T20:08:53.655 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:08:53.656 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:08:53.657 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T20:08:53.657 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-13T20:08:53.659 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T20:08:53.659 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:08:53.659 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.11436 2026-02-13T20:08:53.659 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.11436 2026-02-13T20:08:53.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T20:08:53.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T20:08:53.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/bad-inc-map 2026-02-13T20:08:53.662 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T20:08:53.662 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:08:53.662 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.11436 2026-02-13T20:08:53.662 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.11436 2026-02-13T20:08:53.664 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T20:08:53.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-13T20:08:53.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-13T20:08:53.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T20:08:53.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/bad-inc-map 1' TERM HUP INT 2026-02-13T20:08:53.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:20: run: TEST_bad_inc_map td/bad-inc-map 2026-02-13T20:08:53.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:26: TEST_bad_inc_map: local dir=td/bad-inc-map 2026-02-13T20:08:53.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:28: TEST_bad_inc_map: run_mon td/bad-inc-map a 2026-02-13T20:08:53.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/bad-inc-map 2026-02-13T20:08:53.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T20:08:53.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T20:08:53.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T20:08:53.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/bad-inc-map/a 2026-02-13T20:08:53.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/bad-inc-map/a --run-dir=td/bad-inc-map 2026-02-13T20:08:53.699 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T20:08:53.699 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:08:53.699 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:08:53.699 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:08:53.699 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:08:53.700 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.11436 2026-02-13T20:08:53.700 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.11436/$cluster-$name.asok' 2026-02-13T20:08:53.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/bad-inc-map/a '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.11436/$cluster-$name.asok' --mon-cluster-log-file=td/bad-inc-map/log --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T20:08:53.730 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T20:08:53.731 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T20:08:53.731 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T20:08:53.731 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T20:08:53.732 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T20:08:53.732 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T20:08:53.733 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T20:08:53.733 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T20:08:53.733 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T20:08:53.733 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:08:53.733 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:08:53.733 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.11436 2026-02-13T20:08:53.733 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.11436/ceph-mon.a.asok 2026-02-13T20:08:53.733 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T20:08:53.734 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.11436/ceph-mon.a.asok config get fsid 2026-02-13T20:08:53.788 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T20:08:53.789 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T20:08:53.789 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T20:08:53.789 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T20:08:53.790 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T20:08:53.790 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T20:08:53.790 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T20:08:53.790 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T20:08:53.790 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:08:53.790 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:08:53.791 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.11436 2026-02-13T20:08:53.791 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.11436/ceph-mon.a.asok 2026-02-13T20:08:53.791 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T20:08:53.791 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.11436/ceph-mon.a.asok config get mon_host 2026-02-13T20:08:53.845 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:29: TEST_bad_inc_map: run_mgr td/bad-inc-map x 2026-02-13T20:08:53.846 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/bad-inc-map 2026-02-13T20:08:53.846 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T20:08:53.846 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T20:08:53.846 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T20:08:53.846 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/bad-inc-map/x 2026-02-13T20:08:53.846 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T20:08:53.960 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T20:08:53.960 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:08:53.960 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:08:53.960 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:08:53.961 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:08:53.961 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.11436 2026-02-13T20:08:53.961 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.11436/$cluster-$name.asok' 2026-02-13T20:08:53.961 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T20:08:53.962 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/bad-inc-map/x '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.11436/$cluster-$name.asok' --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T20:08:53.982 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:30: TEST_bad_inc_map: run_osd td/bad-inc-map 0 2026-02-13T20:08:53.982 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-13T20:08:53.982 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:08:53.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T20:08:53.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:08:53.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/0 2026-02-13T20:08:53.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=202de481-9bdb-4333-878c-6a5857968931 --auth-supported=none --mon-host=127.0.0.1:55859 ' 2026-02-13T20:08:53.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:08:53.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:08:53.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:08:53.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/0' 2026-02-13T20:08:53.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/0/journal' 2026-02-13T20:08:53.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:08:53.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:08:53.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-13T20:08:53.984 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:08:53.984 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:08:53.984 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:08:53.984 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:08:53.984 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:08:53.984 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.11436 2026-02-13T20:08:53.984 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.11436/$cluster-$name.asok' 2026-02-13T20:08:53.984 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11436/$cluster-$name.asok' 2026-02-13T20:08:53.984 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:08:53.984 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:08:53.984 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:08:53.984 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-13T20:08:53.984 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-13T20:08:53.985 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:08:53.985 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:08:53.985 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:08:53.985 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:08:53.985 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:08:53.985 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:08:53.985 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/0 2026-02-13T20:08:53.986 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:08:53.986 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=8fd2c361-b4ce-46c8-b91d-cd4960993222 2026-02-13T20:08:53.986 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 8fd2c361-b4ce-46c8-b91d-cd4960993222' 2026-02-13T20:08:53.986 INFO:tasks.workunit.client.0.trial030.stdout:add osd0 8fd2c361-b4ce-46c8-b91d-cd4960993222 2026-02-13T20:08:53.987 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:08:53.995 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDVhI9p9k4tOxAAiFhVNn7Px5NJi+nk2xdfow== 2026-02-13T20:08:53.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDVhI9p9k4tOxAAiFhVNn7Px5NJi+nk2xdfow=="}' 2026-02-13T20:08:53.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 8fd2c361-b4ce-46c8-b91d-cd4960993222 -i td/bad-inc-map/0/new.json 2026-02-13T20:08:54.105 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:08:54.113 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/0/new.json 2026-02-13T20:08:54.114 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=202de481-9bdb-4333-878c-6a5857968931 --auth-supported=none --mon-host=127.0.0.1:55859 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.11436/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDVhI9p9k4tOxAAiFhVNn7Px5NJi+nk2xdfow== --osd-uuid 8fd2c361-b4ce-46c8-b91d-cd4960993222 2026-02-13T20:08:54.129 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:08:54.124+0000 7f4bde8f9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:08:54.130 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:08:54.124+0000 7f4bde8f9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:08:54.131 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:08:54.128+0000 7f4bde8f9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:08:54.132 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:08:54.128+0000 7f4bde8f9a40 -1 bdev(0x56436f666400 td/bad-inc-map/0/block) open stat got: (1) Operation not permitted 2026-02-13T20:08:54.132 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:08:54.128+0000 7f4bde8f9a40 -1 bluestore(td/bad-inc-map/0) _read_fsid unparsable uuid 2026-02-13T20:08:54.764 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/0/keyring 2026-02-13T20:08:54.764 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:08:54.765 INFO:tasks.workunit.client.0.trial030.stdout:adding osd0 key to auth repository 2026-02-13T20:08:54.766 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T20:08:54.766 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:08:54.874 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-13T20:08:54.875 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T20:08:54.875 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=202de481-9bdb-4333-878c-6a5857968931 --auth-supported=none --mon-host=127.0.0.1:55859 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.11436/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:08:54.876 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:08:54.876 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:08:54.876 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:08:54.888 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:08:54.883+0000 7fd0d429ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:08:54.890 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:08:54.883+0000 7fd0d429ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:08:54.890 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:08:54.887+0000 7fd0d429ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:08:54.990 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T20:08:54.990 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:08:54.990 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T20:08:54.990 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:08:54.991 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:08:54.991 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:08:54.991 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:08:54.991 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:08:54.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:08:54.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:08:55.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:08:55.336 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:08:55.331+0000 7fd0d429ca40 -1 Falling back to public interface 2026-02-13T20:08:55.992 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:08:55.987+0000 7fd0d429ca40 -1 osd.0 0 log_to_monitors true 2026-02-13T20:08:56.096 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:08:56.097 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:08:56.097 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:08:56.097 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:08:56.098 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:08:56.098 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:08:56.203 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:08:57.204 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:08:57.204 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:08:57.205 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:08:57.205 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T20:08:57.205 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:08:57.206 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:08:57.419 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3477564699,v1:127.0.0.1:6801/3477564699] [v2:127.0.0.1:6802/3477564699,v1:127.0.0.1:6803/3477564699] exists,up 8fd2c361-b4ce-46c8-b91d-cd4960993222 2026-02-13T20:08:57.423 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:08:57.423 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:08:57.423 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:08:57.423 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:31: TEST_bad_inc_map: run_osd td/bad-inc-map 1 2026-02-13T20:08:57.423 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-13T20:08:57.423 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:08:57.423 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T20:08:57.423 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:08:57.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/1 2026-02-13T20:08:57.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=202de481-9bdb-4333-878c-6a5857968931 --auth-supported=none --mon-host=127.0.0.1:55859 ' 2026-02-13T20:08:57.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:08:57.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:08:57.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:08:57.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/1' 2026-02-13T20:08:57.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/1/journal' 2026-02-13T20:08:57.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:08:57.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:08:57.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-13T20:08:57.424 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:08:57.424 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:08:57.424 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:08:57.425 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:08:57.425 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:08:57.425 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.11436 2026-02-13T20:08:57.425 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.11436/$cluster-$name.asok' 2026-02-13T20:08:57.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11436/$cluster-$name.asok' 2026-02-13T20:08:57.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:08:57.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:08:57.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:08:57.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-13T20:08:57.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-13T20:08:57.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:08:57.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:08:57.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:08:57.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:08:57.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:08:57.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:08:57.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/1 2026-02-13T20:08:57.426 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:08:57.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=23f78211-e8a9-4ec3-8847-a57af25a0c45 2026-02-13T20:08:57.426 INFO:tasks.workunit.client.0.trial030.stdout:add osd1 23f78211-e8a9-4ec3-8847-a57af25a0c45 2026-02-13T20:08:57.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 23f78211-e8a9-4ec3-8847-a57af25a0c45' 2026-02-13T20:08:57.427 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:08:57.435 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDZhI9ppevIGRAA65uTJehCex5jMIWXqUkMkQ== 2026-02-13T20:08:57.435 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDZhI9ppevIGRAA65uTJehCex5jMIWXqUkMkQ=="}' 2026-02-13T20:08:57.435 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 23f78211-e8a9-4ec3-8847-a57af25a0c45 -i td/bad-inc-map/1/new.json 2026-02-13T20:08:57.649 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:08:57.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/1/new.json 2026-02-13T20:08:57.659 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=202de481-9bdb-4333-878c-6a5857968931 --auth-supported=none --mon-host=127.0.0.1:55859 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.11436/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDZhI9ppevIGRAA65uTJehCex5jMIWXqUkMkQ== --osd-uuid 23f78211-e8a9-4ec3-8847-a57af25a0c45 2026-02-13T20:08:57.675 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:08:57.671+0000 7f7eb8bcca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:08:57.677 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:08:57.671+0000 7f7eb8bcca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:08:57.678 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:08:57.671+0000 7f7eb8bcca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:08:57.678 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:08:57.675+0000 7f7eb8bcca40 -1 bdev(0x55cbc7d14400 td/bad-inc-map/1/block) open stat got: (1) Operation not permitted 2026-02-13T20:08:57.678 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:08:57.675+0000 7f7eb8bcca40 -1 bluestore(td/bad-inc-map/1) _read_fsid unparsable uuid 2026-02-13T20:08:58.394 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/1/keyring 2026-02-13T20:08:58.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:08:58.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T20:08:58.395 INFO:tasks.workunit.client.0.trial030.stdout:adding osd1 key to auth repository 2026-02-13T20:08:58.396 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:08:58.695 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-13T20:08:58.696 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T20:08:58.696 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=202de481-9bdb-4333-878c-6a5857968931 --auth-supported=none --mon-host=127.0.0.1:55859 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.11436/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:08:58.696 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:08:58.696 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:08:58.696 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:08:58.717 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:08:58.711+0000 7f555ac2da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:08:58.718 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:08:58.715+0000 7f555ac2da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:08:58.719 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:08:58.715+0000 7f555ac2da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:08:58.905 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T20:08:58.905 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:08:58.906 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T20:08:58.906 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:08:58.906 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:08:58.906 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:08:58.906 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:08:58.906 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:08:58.906 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:08:58.906 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:08:59.120 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:08:59.115+0000 7f555ac2da40 -1 Falling back to public interface 2026-02-13T20:08:59.129 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:08:59.703 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:08:59.699+0000 7f555ac2da40 -1 osd.1 0 log_to_monitors true 2026-02-13T20:09:00.131 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:09:00.131 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:09:00.131 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:09:00.132 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:09:00.132 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:09:00.132 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:09:00.352 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:09:01.353 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:09:01.354 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:09:01.354 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:09:01.354 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T20:09:01.355 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:09:01.355 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:09:01.560 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3113253405,v1:127.0.0.1:6811/3113253405] [v2:127.0.0.1:6812/3113253405,v1:127.0.0.1:6813/3113253405] exists,up 23f78211-e8a9-4ec3-8847-a57af25a0c45 2026-02-13T20:09:01.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:09:01.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:09:01.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:09:01.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:32: TEST_bad_inc_map: run_osd td/bad-inc-map 2 2026-02-13T20:09:01.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-13T20:09:01.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:09:01.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T20:09:01.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:09:01.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/2 2026-02-13T20:09:01.565 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=202de481-9bdb-4333-878c-6a5857968931 --auth-supported=none --mon-host=127.0.0.1:55859 ' 2026-02-13T20:09:01.565 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:09:01.565 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:09:01.565 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:09:01.565 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/2' 2026-02-13T20:09:01.565 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/2/journal' 2026-02-13T20:09:01.565 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:09:01.565 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:09:01.565 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-13T20:09:01.565 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:09:01.565 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:09:01.565 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:09:01.566 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:09:01.566 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:09:01.566 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.11436 2026-02-13T20:09:01.566 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.11436/$cluster-$name.asok' 2026-02-13T20:09:01.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11436/$cluster-$name.asok' 2026-02-13T20:09:01.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:09:01.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:09:01.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:09:01.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-13T20:09:01.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-13T20:09:01.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:09:01.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:09:01.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:09:01.567 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:09:01.567 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:09:01.567 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:09:01.567 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/2 2026-02-13T20:09:01.567 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:09:01.568 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7b51778c-0a2a-42b3-b520-b681f8b54d4a 2026-02-13T20:09:01.568 INFO:tasks.workunit.client.0.trial030.stdout:add osd2 7b51778c-0a2a-42b3-b520-b681f8b54d4a 2026-02-13T20:09:01.568 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 7b51778c-0a2a-42b3-b520-b681f8b54d4a' 2026-02-13T20:09:01.568 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:09:01.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDdhI9plRo4IhAA0rr73/ec/byLL54kFCUxOQ== 2026-02-13T20:09:01.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDdhI9plRo4IhAA0rr73/ec/byLL54kFCUxOQ=="}' 2026-02-13T20:09:01.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7b51778c-0a2a-42b3-b520-b681f8b54d4a -i td/bad-inc-map/2/new.json 2026-02-13T20:09:01.805 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:09:01.814 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/2/new.json 2026-02-13T20:09:01.815 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=202de481-9bdb-4333-878c-6a5857968931 --auth-supported=none --mon-host=127.0.0.1:55859 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.11436/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDdhI9plRo4IhAA0rr73/ec/byLL54kFCUxOQ== --osd-uuid 7b51778c-0a2a-42b3-b520-b681f8b54d4a 2026-02-13T20:09:01.831 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:01.827+0000 7eff2a526a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:01.833 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:01.827+0000 7eff2a526a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:01.834 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:01.827+0000 7eff2a526a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:01.834 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:01.827+0000 7eff2a526a40 -1 bdev(0x558f539e2400 td/bad-inc-map/2/block) open stat got: (1) Operation not permitted 2026-02-13T20:09:01.835 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:01.831+0000 7eff2a526a40 -1 bluestore(td/bad-inc-map/2) _read_fsid unparsable uuid 2026-02-13T20:09:02.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/2/keyring 2026-02-13T20:09:02.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:09:02.475 INFO:tasks.workunit.client.0.trial030.stdout:adding osd2 key to auth repository 2026-02-13T20:09:02.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T20:09:02.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:09:02.778 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-13T20:09:02.779 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T20:09:02.779 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=202de481-9bdb-4333-878c-6a5857968931 --auth-supported=none --mon-host=127.0.0.1:55859 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.11436/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:09:02.779 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:09:02.780 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:09:02.780 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:09:02.801 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:02.795+0000 7f80f8750a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:02.803 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:02.799+0000 7f80f8750a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:02.804 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:02.799+0000 7f80f8750a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:02.986 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T20:09:02.987 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:09:02.987 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T20:09:02.987 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:09:02.987 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:09:02.987 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:09:02.987 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:09:02.988 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:09:02.988 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:09:02.988 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:09:03.206 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:09:03.256 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:03.251+0000 7f80f8750a40 -1 Falling back to public interface 2026-02-13T20:09:03.847 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:03.843+0000 7f80f8750a40 -1 osd.2 0 log_to_monitors true 2026-02-13T20:09:04.207 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:09:04.208 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:09:04.208 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:09:04.208 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:09:04.208 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:09:04.209 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:09:04.417 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:09:05.419 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:09:05.419 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:09:05.419 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:09:05.420 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T20:09:05.420 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:09:05.420 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:09:05.622 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2612285941,v1:127.0.0.1:6819/2612285941] [v2:127.0.0.1:6820/2612285941,v1:127.0.0.1:6821/2612285941] exists,up 7b51778c-0a2a-42b3-b520-b681f8b54d4a 2026-02-13T20:09:05.623 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:09:05.623 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:09:05.623 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:09:05.623 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:34: TEST_bad_inc_map: ceph config set osd.2 osd_inject_bad_map_crc_probability 1 2026-02-13T20:09:05.833 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:37: TEST_bad_inc_map: create_pool foo 8 2026-02-13T20:09:05.833 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 8 2026-02-13T20:09:06.110 INFO:tasks.workunit.client.0.trial030.stderr:pool 'foo' already exists 2026-02-13T20:09:06.119 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T20:09:07.120 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:38: TEST_bad_inc_map: ceph osd pool set foo min_size 1 2026-02-13T20:09:07.424 INFO:tasks.workunit.client.0.trial030.stderr:set pool 1 min_size to 1 2026-02-13T20:09:07.435 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:39: TEST_bad_inc_map: ceph osd pool set foo min_size 2 2026-02-13T20:09:07.729 INFO:tasks.workunit.client.0.trial030.stderr:set pool 1 min_size to 2 2026-02-13T20:09:07.742 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:41: TEST_bad_inc_map: sleep 5 2026-02-13T20:09:12.743 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: TIMEOUT=10 2026-02-13T20:09:12.743 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: wait_for_osd up 0 2026-02-13T20:09:12.743 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:09:12.743 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T20:09:12.743 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:09:12.743 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:09:12.743 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-13T20:09:12.743 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:09:12.743 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:09:12.743 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:09:12.743 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:09:12.959 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 5 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3477564699,v1:127.0.0.1:6801/3477564699] [v2:127.0.0.1:6802/3477564699,v1:127.0.0.1:6803/3477564699] exists,up 8fd2c361-b4ce-46c8-b91d-cd4960993222 2026-02-13T20:09:12.961 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:09:12.961 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:09:12.961 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:09:12.961 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: TIMEOUT=10 2026-02-13T20:09:12.961 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: wait_for_osd up 1 2026-02-13T20:09:12.961 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:09:12.961 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T20:09:12.961 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:09:12.961 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:09:12.961 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-13T20:09:12.962 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:09:12.962 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:09:12.962 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:09:12.963 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:09:13.174 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 9 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3113253405,v1:127.0.0.1:6811/3113253405] [v2:127.0.0.1:6812/3113253405,v1:127.0.0.1:6813/3113253405] exists,up 23f78211-e8a9-4ec3-8847-a57af25a0c45 2026-02-13T20:09:13.175 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:09:13.175 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:09:13.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:09:13.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: TIMEOUT=10 2026-02-13T20:09:13.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: wait_for_osd up 2 2026-02-13T20:09:13.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:09:13.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T20:09:13.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:09:13.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:09:13.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-13T20:09:13.176 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:09:13.177 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:09:13.177 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:09:13.177 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:09:13.378 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 13 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2612285941,v1:127.0.0.1:6819/2612285941] [v2:127.0.0.1:6820/2612285941,v1:127.0.0.1:6821/2612285941] exists,up 7b51778c-0a2a-42b3-b520-b681f8b54d4a 2026-02-13T20:09:13.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:09:13.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:09:13.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:09:13.380 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:49: TEST_bad_inc_map: grep 'injecting map crc failure' td/bad-inc-map/osd.2.log 2026-02-13T20:09:13.381 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-13T20:09:06.055+0000 7f80e56ec640 -1 osd.2 13 handle_osd_map injecting map crc failure 2026-02-13T20:09:13.381 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-13T20:09:06.155+0000 7f80e76f0640 -1 osd.2 14 handle_osd_map injecting map crc failure 2026-02-13T20:09:13.381 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-13T20:09:06.155+0000 7f80e76f0640 -1 osd.2 14 handle_osd_map injecting map crc failure 2026-02-13T20:09:13.381 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-13T20:09:07.315+0000 7f80e76f0640 -1 osd.2 15 handle_osd_map injecting map crc failure 2026-02-13T20:09:13.381 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-13T20:09:07.419+0000 7f80e76f0640 -1 osd.2 17 handle_osd_map injecting map crc failure 2026-02-13T20:09:13.381 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-13T20:09:07.419+0000 7f80e56ec640 -1 osd.2 17 handle_osd_map injecting map crc failure 2026-02-13T20:09:13.381 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-13T20:09:07.623+0000 7f80e76f0640 -1 osd.2 18 handle_osd_map injecting map crc failure 2026-02-13T20:09:13.382 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-13T20:09:07.723+0000 7f80e76f0640 -1 osd.2 19 handle_osd_map injecting map crc failure 2026-02-13T20:09:13.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:50: TEST_bad_inc_map: grep 'bailing because last' td/bad-inc-map/osd.2.log 2026-02-13T20:09:13.383 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-13T20:09:06.055+0000 7f80e56ec640 10 osd.2 13 handle_osd_map bailing because last < start (13<14) 2026-02-13T20:09:13.383 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-13T20:09:06.155+0000 7f80e76f0640 10 osd.2 14 handle_osd_map bailing because last < start (14<15) 2026-02-13T20:09:13.383 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-13T20:09:06.155+0000 7f80e76f0640 10 osd.2 14 handle_osd_map bailing because last < start (14<15) 2026-02-13T20:09:13.383 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-13T20:09:07.315+0000 7f80e76f0640 10 osd.2 15 handle_osd_map bailing because last < start (15<16) 2026-02-13T20:09:13.383 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-13T20:09:07.419+0000 7f80e76f0640 10 osd.2 17 handle_osd_map bailing because last < start (17<18) 2026-02-13T20:09:13.383 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-13T20:09:07.419+0000 7f80e56ec640 10 osd.2 17 handle_osd_map bailing because last < start (17<18) 2026-02-13T20:09:13.383 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-13T20:09:07.623+0000 7f80e76f0640 10 osd.2 18 handle_osd_map bailing because last < start (18<19) 2026-02-13T20:09:13.383 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-13T20:09:07.723+0000 7f80e76f0640 10 osd.2 19 handle_osd_map bailing because last < start (19<20) 2026-02-13T20:09:13.383 INFO:tasks.workunit.client.0.trial030.stdout:success 2026-02-13T20:09:13.384 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:52: TEST_bad_inc_map: echo success 2026-02-13T20:09:13.384 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:54: TEST_bad_inc_map: delete_pool foo 2026-02-13T20:09:13.384 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=foo 2026-02-13T20:09:13.384 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete foo foo --yes-i-really-really-mean-it 2026-02-13T20:09:13.602 INFO:tasks.workunit.client.0.trial030.stderr:pool 'foo' does not exist 2026-02-13T20:09:13.611 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:55: TEST_bad_inc_map: kill_daemons td/bad-inc-map 2026-02-13T20:09:13.612 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:09:13.613 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:09:13.613 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:09:13.613 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:09:13.613 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:09:18.928 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:09:18.928 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:21: run: teardown td/bad-inc-map 2026-02-13T20:09:18.928 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-13T20:09:18.928 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T20:09:18.928 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-13T20:09:18.928 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:09:18.928 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:09:18.929 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:09:18.929 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:09:18.929 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:09:18.935 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:09:18.935 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T20:09:18.936 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T20:09:18.936 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T20:09:18.938 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T20:09:18.938 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T20:09:18.938 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T20:09:18.939 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:09:18.939 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T20:09:18.940 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T20:09:18.940 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:09:18.941 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:09:18.942 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T20:09:18.942 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-13T20:09:18.952 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T20:09:18.952 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:09:18.952 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.11436 2026-02-13T20:09:18.952 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.11436 2026-02-13T20:09:18.954 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T20:09:18.954 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T20:09:18.954 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-13T20:09:18.954 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/bad-inc-map 0 2026-02-13T20:09:18.954 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-13T20:09:18.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-13T20:09:18.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-13T20:09:18.955 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:09:18.955 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:09:18.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:09:18.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:09:18.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:09:18.956 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:09:18.956 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T20:09:18.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T20:09:18.957 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T20:09:18.959 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T20:09:18.959 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T20:09:18.959 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T20:09:18.960 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:09:18.960 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T20:09:18.961 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T20:09:18.961 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:09:18.962 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:09:18.963 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-13T20:09:18.963 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-13T20:09:18.964 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T20:09:18.964 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:09:18.965 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.11436 2026-02-13T20:09:18.965 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.11436 2026-02-13T20:09:18.966 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T20:09:18.966 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T20:09:18.966 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-13T20:09:18.967 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-13T20:09:18.967 DEBUG:teuthology.orchestra.run.trial030:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-13T20:09:19.022 INFO:tasks.workunit:Running workunit osd/divergent-priors.sh... 2026-02-13T20:09:19.023 DEBUG:teuthology.orchestra.run.trial030:workunit test osd/divergent-priors.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=afefaa40503a4bf024e96f97dd7f852b75f00ad6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh 2026-02-13T20:09:19.076 INFO:tasks.workunit.client.0.trial030.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-13T20:09:19.079 INFO:tasks.workunit.client.0.trial030.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-13T20:09:19.079 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-13T20:09:19.080 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-13T20:09:19.080 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-13T20:09:19.080 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-13T20:09:19.080 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-13T20:09:19.080 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-13T20:09:19.080 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-13T20:09:19.080 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-13T20:09:19.080 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/divergent-priors 2026-02-13T20:09:19.080 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:21: run: local dir=td/divergent-priors 2026-02-13T20:09:19.080 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:22: run: shift 2026-02-13T20:09:19.081 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: export loglen=12 2026-02-13T20:09:19.081 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: loglen=12 2026-02-13T20:09:19.081 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: export divisor=3 2026-02-13T20:09:19.081 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: divisor=3 2026-02-13T20:09:19.081 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: expr 12 / 2 2026-02-13T20:09:19.082 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: export trim=6 2026-02-13T20:09:19.082 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: trim=6 2026-02-13T20:09:19.082 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: expr 6 / 3 2026-02-13T20:09:19.082 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: export DIVERGENT_WRITE=2 2026-02-13T20:09:19.082 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: DIVERGENT_WRITE=2 2026-02-13T20:09:19.083 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: expr 6 / 3 2026-02-13T20:09:19.083 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: export DIVERGENT_REMOVE=2 2026-02-13T20:09:19.084 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: DIVERGENT_REMOVE=2 2026-02-13T20:09:19.084 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: expr 6 / 3 2026-02-13T20:09:19.085 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: export DIVERGENT_CREATE=2 2026-02-13T20:09:19.086 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: DIVERGENT_CREATE=2 2026-02-13T20:09:19.086 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: export poolname=test 2026-02-13T20:09:19.086 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: poolname=test 2026-02-13T20:09:19.086 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: export testobjects=100 2026-02-13T20:09:19.086 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: testobjects=100 2026-02-13T20:09:19.086 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: export CEPH_MON=127.0.0.1:7115 2026-02-13T20:09:19.086 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: CEPH_MON=127.0.0.1:7115 2026-02-13T20:09:19.086 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:35: run: export CEPH_ARGS 2026-02-13T20:09:19.086 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: uuidgen 2026-02-13T20:09:19.087 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: CEPH_ARGS+='--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none ' 2026-02-13T20:09:19.087 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:37: run: CEPH_ARGS+='--mon-host=127.0.0.1:7115 ' 2026-02-13T20:09:19.087 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:39: run: CEPH_ARGS+='--osd_force_auth_primary_missing_objects=1000000 ' 2026-02-13T20:09:19.088 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:40: run: CEPH_ARGS+='--osd_debug_pg_log_writeout=true ' 2026-02-13T20:09:19.088 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:41: run: CEPH_ARGS+='--osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:09:19.088 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: set 2026-02-13T20:09:19.088 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-13T20:09:19.090 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: local 'funcs=TEST_divergent 2026-02-13T20:09:19.091 INFO:tasks.workunit.client.0.trial030.stderr:TEST_divergent_2 2026-02-13T20:09:19.091 INFO:tasks.workunit.client.0.trial030.stderr:TEST_divergent_3 2026-02-13T20:09:19.091 INFO:tasks.workunit.client.0.trial030.stderr:TEST_divergent_ec' 2026-02-13T20:09:19.091 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-13T20:09:19.091 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-13T20:09:19.091 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-13T20:09:19.091 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-13T20:09:19.091 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-13T20:09:19.091 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T20:09:19.091 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-13T20:09:19.091 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:09:19.091 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:09:19.092 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:09:19.092 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:09:19.092 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:09:19.092 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:09:19.093 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T20:09:19.094 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T20:09:19.094 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T20:09:19.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T20:09:19.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T20:09:19.096 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T20:09:19.096 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:09:19.096 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T20:09:19.097 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T20:09:19.097 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:09:19.098 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:09:19.099 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T20:09:19.099 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-13T20:09:19.101 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T20:09:19.101 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:09:19.101 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:09:19.101 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19555 2026-02-13T20:09:19.102 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T20:09:19.102 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T20:09:19.102 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-13T20:09:19.104 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T20:09:19.104 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:09:19.104 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:09:19.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.19555 2026-02-13T20:09:19.105 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T20:09:19.106 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-13T20:09:19.106 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-13T20:09:19.106 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T20:09:19.106 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-13T20:09:19.106 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent td/divergent-priors 2026-02-13T20:09:19.106 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:57: TEST_divergent: local dir=td/divergent-priors 2026-02-13T20:09:19.107 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:59: TEST_divergent: file_with_random_data 2026-02-13T20:09:19.107 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-13T20:09:19.107 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-13T20:09:19.107 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:19.108 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.T5mBZmXxdw bs=512 count=1 2026-02-13T20:09:19.109 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records in 2026-02-13T20:09:19.109 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records out 2026-02-13T20:09:19.109 INFO:tasks.workunit.client.0.trial030.stderr:512 bytes copied, 0.000197035 s, 2.6 MB/s 2026-02-13T20:09:19.109 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:19.110 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:59: TEST_divergent: local dummyfile=/tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:19.110 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:60: TEST_divergent: local num_osds=3 2026-02-13T20:09:19.110 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: expr 3 - 1 2026-02-13T20:09:19.111 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: seq 0 2 2026-02-13T20:09:19.112 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: local 'osds=0 2026-02-13T20:09:19.112 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:09:19.112 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:09:19.113 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:62: TEST_divergent: run_mon td/divergent-priors a 2026-02-13T20:09:19.113 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-13T20:09:19.113 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T20:09:19.113 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T20:09:19.113 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T20:09:19.113 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-13T20:09:19.113 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-13T20:09:19.140 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T20:09:19.141 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:09:19.141 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:09:19.141 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:09:19.141 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:09:19.141 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:09:19.141 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:09:19.142 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T20:09:19.172 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T20:09:19.173 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T20:09:19.174 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T20:09:19.174 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T20:09:19.174 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T20:09:19.175 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T20:09:19.175 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T20:09:19.175 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T20:09:19.175 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T20:09:19.175 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:09:19.175 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:09:19.175 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:09:19.175 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-mon.a.asok 2026-02-13T20:09:19.176 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T20:09:19.176 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19555/ceph-mon.a.asok config get fsid 2026-02-13T20:09:19.230 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T20:09:19.230 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T20:09:19.230 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T20:09:19.230 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T20:09:19.230 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T20:09:19.231 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T20:09:19.231 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T20:09:19.231 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T20:09:19.232 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:09:19.232 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:09:19.232 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:09:19.232 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-mon.a.asok 2026-02-13T20:09:19.232 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T20:09:19.232 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19555/ceph-mon.a.asok config get mon_host 2026-02-13T20:09:19.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:63: TEST_divergent: run_mgr td/divergent-priors x 2026-02-13T20:09:19.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-13T20:09:19.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T20:09:19.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T20:09:19.288 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T20:09:19.288 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-13T20:09:19.288 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T20:09:19.405 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T20:09:19.405 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:09:19.405 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:09:19.405 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:09:19.405 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:09:19.406 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:09:19.406 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:09:19.406 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T20:09:19.407 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T20:09:19.429 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-13T20:09:19.429 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 0 2026-02-13T20:09:19.429 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T20:09:19.429 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:09:19.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T20:09:19.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:09:19.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-13T20:09:19.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:09:19.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:09:19.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:09:19.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:09:19.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-13T20:09:19.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-13T20:09:19.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:09:19.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:09:19.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:09:19.431 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:09:19.431 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:09:19.431 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:09:19.431 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:09:19.431 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:09:19.431 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:09:19.431 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:09:19.431 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:09:19.431 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:09:19.431 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:09:19.431 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:09:19.431 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:09:19.431 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:09:19.432 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:09:19.432 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:09:19.432 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:09:19.432 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:09:19.432 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:09:19.432 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:09:19.432 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-13T20:09:19.433 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:09:19.433 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1051582f-4a18-4521-90d1-d9c240d69770 2026-02-13T20:09:19.433 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 1051582f-4a18-4521-90d1-d9c240d69770' 2026-02-13T20:09:19.433 INFO:tasks.workunit.client.0.trial030.stdout:add osd0 1051582f-4a18-4521-90d1-d9c240d69770 2026-02-13T20:09:19.434 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:09:19.445 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDvhI9pOoViGhAAxSVpdejLTd7IKFBHrmGuqA== 2026-02-13T20:09:19.445 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDvhI9pOoViGhAAxSVpdejLTd7IKFBHrmGuqA=="}' 2026-02-13T20:09:19.446 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1051582f-4a18-4521-90d1-d9c240d69770 -i td/divergent-priors/0/new.json 2026-02-13T20:09:19.559 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:09:19.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-13T20:09:19.567 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDvhI9pOoViGhAAxSVpdejLTd7IKFBHrmGuqA== --osd-uuid 1051582f-4a18-4521-90d1-d9c240d69770 2026-02-13T20:09:19.586 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:19.579+0000 7feb11b3fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:19.588 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:19.583+0000 7feb11b3fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:19.589 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:19.583+0000 7feb11b3fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:19.589 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:19.583+0000 7feb11b3fa40 -1 bdev(0x56457ef0c400 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-13T20:09:19.590 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:19.583+0000 7feb11b3fa40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-13T20:09:20.289 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-13T20:09:20.289 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:09:20.290 INFO:tasks.workunit.client.0.trial030.stdout:adding osd0 key to auth repository 2026-02-13T20:09:20.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T20:09:20.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:09:20.403 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-13T20:09:20.404 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T20:09:20.404 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:09:20.404 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:09:20.404 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:09:20.404 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:09:20.423 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:20.419+0000 7fea5d1c0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:20.424 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:20.419+0000 7fea5d1c0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:20.426 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:20.419+0000 7fea5d1c0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:20.516 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T20:09:20.516 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:09:20.516 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T20:09:20.516 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:09:20.516 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:09:20.517 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:09:20.517 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:09:20.517 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:09:20.517 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:09:20.518 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:09:20.626 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:09:20.872 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:20.867+0000 7fea5d1c0a40 -1 Falling back to public interface 2026-02-13T20:09:21.544 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:21.539+0000 7fea5d1c0a40 -1 osd.0 0 log_to_monitors true 2026-02-13T20:09:21.628 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:09:21.628 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:09:21.628 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:09:21.628 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:09:21.629 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:09:21.631 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:09:21.774 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:09:22.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:09:22.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:09:22.776 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:09:22.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T20:09:22.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:09:22.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:09:22.996 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2183347737,v1:127.0.0.1:6801/2183347737] [v2:127.0.0.1:6802/2183347737,v1:127.0.0.1:6803/2183347737] exists,up 1051582f-4a18-4521-90d1-d9c240d69770 2026-02-13T20:09:22.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:09:22.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:09:22.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:09:22.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-13T20:09:22.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 1 2026-02-13T20:09:22.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T20:09:22.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:09:23.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T20:09:23.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:09:23.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-13T20:09:23.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:09:23.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:09:23.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:09:23.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:09:23.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T20:09:23.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T20:09:23.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:09:23.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:09:23.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:09:23.001 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:09:23.001 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:09:23.001 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:09:23.001 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:09:23.001 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:09:23.001 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:09:23.001 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:09:23.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:09:23.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:09:23.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:09:23.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:09:23.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:09:23.002 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:09:23.002 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:09:23.002 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:09:23.002 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:09:23.002 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:09:23.002 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:09:23.002 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:09:23.002 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-13T20:09:23.002 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:09:23.003 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=4d94185d-eb34-4aae-ab55-fc37e2d7eea1 2026-02-13T20:09:23.003 INFO:tasks.workunit.client.0.trial030.stdout:add osd1 4d94185d-eb34-4aae-ab55-fc37e2d7eea1 2026-02-13T20:09:23.003 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 4d94185d-eb34-4aae-ab55-fc37e2d7eea1' 2026-02-13T20:09:23.004 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:09:23.014 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDzhI9pav2xABAAKu8M27YRQSWYHp3KgdSkTQ== 2026-02-13T20:09:23.015 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDzhI9pav2xABAAKu8M27YRQSWYHp3KgdSkTQ=="}' 2026-02-13T20:09:23.015 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 4d94185d-eb34-4aae-ab55-fc37e2d7eea1 -i td/divergent-priors/1/new.json 2026-02-13T20:09:23.248 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:09:23.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-13T20:09:23.257 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDzhI9pav2xABAAKu8M27YRQSWYHp3KgdSkTQ== --osd-uuid 4d94185d-eb34-4aae-ab55-fc37e2d7eea1 2026-02-13T20:09:23.277 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:23.271+0000 7f07c9f67a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:23.278 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:23.271+0000 7f07c9f67a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:23.279 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:23.275+0000 7f07c9f67a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:23.280 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:23.275+0000 7f07c9f67a40 -1 bdev(0x55ae5875e400 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-13T20:09:23.280 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:23.275+0000 7f07c9f67a40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-13T20:09:23.965 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-13T20:09:23.965 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:09:23.966 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T20:09:23.966 INFO:tasks.workunit.client.0.trial030.stdout:adding osd1 key to auth repository 2026-02-13T20:09:23.966 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:09:24.275 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-13T20:09:24.276 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T20:09:24.276 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:09:24.277 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:09:24.277 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:09:24.277 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:09:24.304 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:24.299+0000 7fec53d35a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:24.306 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:24.299+0000 7fec53d35a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:24.307 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:24.303+0000 7fec53d35a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:24.490 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T20:09:24.491 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:09:24.491 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T20:09:24.491 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:09:24.491 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:09:24.491 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:09:24.491 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:09:24.491 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:09:24.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:09:24.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:09:24.704 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:24.699+0000 7fec53d35a40 -1 Falling back to public interface 2026-02-13T20:09:24.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:09:25.252 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:25.247+0000 7fec53d35a40 -1 osd.1 0 log_to_monitors true 2026-02-13T20:09:25.713 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:09:25.713 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:09:25.713 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:09:25.713 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:09:25.713 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:09:25.714 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:09:25.926 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1623357314,v1:127.0.0.1:6811/1623357314] [v2:127.0.0.1:6812/1623357314,v1:127.0.0.1:6813/1623357314] exists,up 4d94185d-eb34-4aae-ab55-fc37e2d7eea1 2026-02-13T20:09:25.929 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:09:25.929 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:09:25.929 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:09:25.929 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-13T20:09:25.930 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 2 2026-02-13T20:09:25.930 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T20:09:25.930 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:09:25.930 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T20:09:25.930 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:09:25.930 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-13T20:09:25.930 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:09:25.930 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:09:25.930 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:09:25.930 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:09:25.930 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-13T20:09:25.931 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-13T20:09:25.931 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:09:25.931 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:09:25.931 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:09:25.931 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:09:25.931 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:09:25.931 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:09:25.931 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:09:25.931 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:09:25.931 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:09:25.931 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:09:25.931 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:09:25.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:09:25.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:09:25.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:09:25.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:09:25.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:09:25.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:09:25.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:09:25.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:09:25.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:09:25.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:09:25.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:09:25.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-13T20:09:25.933 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:09:25.933 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b7ec0965-b075-4b83-8b19-41d4d417781c 2026-02-13T20:09:25.933 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 b7ec0965-b075-4b83-8b19-41d4d417781c' 2026-02-13T20:09:25.934 INFO:tasks.workunit.client.0.trial030.stdout:add osd2 b7ec0965-b075-4b83-8b19-41d4d417781c 2026-02-13T20:09:25.934 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:09:25.944 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD1hI9poG8bOBAANIB3MC7XXac468R2m/Xb9Q== 2026-02-13T20:09:25.944 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD1hI9poG8bOBAANIB3MC7XXac468R2m/Xb9Q=="}' 2026-02-13T20:09:25.945 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b7ec0965-b075-4b83-8b19-41d4d417781c -i td/divergent-priors/2/new.json 2026-02-13T20:09:26.171 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:09:26.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-13T20:09:26.182 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD1hI9poG8bOBAANIB3MC7XXac468R2m/Xb9Q== --osd-uuid b7ec0965-b075-4b83-8b19-41d4d417781c 2026-02-13T20:09:26.208 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:26.202+0000 7fb7135b2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:26.210 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:26.202+0000 7fb7135b2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:26.211 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:26.206+0000 7fb7135b2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:26.211 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:26.206+0000 7fb7135b2a40 -1 bdev(0x55707645c400 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-13T20:09:26.211 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:26.206+0000 7fb7135b2a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-13T20:09:26.926 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-13T20:09:26.926 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:09:26.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T20:09:26.927 INFO:tasks.workunit.client.0.trial030.stdout:adding osd2 key to auth repository 2026-02-13T20:09:26.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:09:27.219 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-13T20:09:27.220 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T20:09:27.220 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:09:27.220 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:09:27.221 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:09:27.221 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:09:27.248 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:27.242+0000 7f8bc4089a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:27.250 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:27.242+0000 7f8bc4089a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:27.251 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:27.246+0000 7f8bc4089a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:27.432 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T20:09:27.432 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:09:27.432 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T20:09:27.432 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:09:27.432 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:09:27.432 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:09:27.433 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:09:27.433 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:09:27.433 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:09:27.434 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:09:27.656 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:09:27.716 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:27.710+0000 7f8bc4089a40 -1 Falling back to public interface 2026-02-13T20:09:28.379 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:28.370+0000 7f8bc4089a40 -1 osd.2 0 log_to_monitors true 2026-02-13T20:09:28.657 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:09:28.657 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:09:28.657 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:09:28.657 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:09:28.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:09:28.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:09:28.870 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:09:29.872 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:09:29.872 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:09:29.872 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:09:29.873 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T20:09:29.873 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:09:29.873 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:09:30.086 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2214100685,v1:127.0.0.1:6819/2214100685] [v2:127.0.0.1:6820/2214100685,v1:127.0.0.1:6821/2214100685] exists,up b7ec0965-b075-4b83-8b19-41d4d417781c 2026-02-13T20:09:30.087 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:09:30.087 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:09:30.087 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:09:30.087 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:69: TEST_divergent: ceph osd set noout 2026-02-13T20:09:30.378 INFO:tasks.workunit.client.0.trial030.stderr:noout is set 2026-02-13T20:09:30.391 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:70: TEST_divergent: ceph osd set noin 2026-02-13T20:09:30.681 INFO:tasks.workunit.client.0.trial030.stderr:noin is set 2026-02-13T20:09:30.694 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:71: TEST_divergent: ceph osd set nodown 2026-02-13T20:09:30.986 INFO:tasks.workunit.client.0.trial030.stderr:nodown is set 2026-02-13T20:09:30.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:72: TEST_divergent: create_pool test 1 1 2026-02-13T20:09:30.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-13T20:09:31.243 INFO:tasks.workunit.client.0.trial030.stderr:pool 'test' already exists 2026-02-13T20:09:31.253 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T20:09:32.254 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:73: TEST_divergent: ceph osd pool set test size 3 2026-02-13T20:09:32.564 INFO:tasks.workunit.client.0.trial030.stderr:set pool 1 size to 3 2026-02-13T20:09:32.575 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:74: TEST_divergent: ceph osd pool set test min_size 2 2026-02-13T20:09:32.867 INFO:tasks.workunit.client.0.trial030.stderr:set pool 1 min_size to 2 2026-02-13T20:09:32.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:76: TEST_divergent: flush_pg_stats 2026-02-13T20:09:32.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T20:09:32.878 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T20:09:33.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T20:09:33.096 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:09:33.096 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:09:33.096 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T20:09:33.096 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:09:33.096 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-13T20:09:33.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-13T20:09:33.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-13T20:09:33.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-13T20:09:33.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:09:33.180 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-13T20:09:33.262 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-13T20:09:33.263 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-13T20:09:33.263 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668' 2026-02-13T20:09:33.263 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:09:33.263 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-13T20:09:33.347 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574852 2026-02-13T20:09:33.348 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574852 2026-02-13T20:09:33.348 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668 2-55834574852' 2026-02-13T20:09:33.348 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:09:33.348 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-13T20:09:33.348 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:09:33.349 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-13T20:09:33.350 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-13T20:09:33.350 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:09:33.351 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-13T20:09:33.351 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-13T20:09:33.352 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836485 2026-02-13T20:09:33.352 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:09:33.563 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836485 2026-02-13T20:09:33.563 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:09:34.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T20:09:34.565 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:09:34.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-13T20:09:34.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:09:34.785 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-13T20:09:34.785 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:09:34.787 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-13T20:09:34.787 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-13T20:09:34.787 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:09:34.789 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-13T20:09:34.789 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 38654705668 2026-02-13T20:09:34.789 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-13T20:09:34.790 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T20:09:35.015 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-13T20:09:35.016 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:09:35.016 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574852 2026-02-13T20:09:35.016 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:09:35.017 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-13T20:09:35.018 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574852 2026-02-13T20:09:35.018 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:09:35.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574852 2026-02-13T20:09:35.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574852' 2026-02-13T20:09:35.020 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 55834574852 2026-02-13T20:09:35.020 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:09:35.232 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574852 -lt 55834574852 2026-02-13T20:09:35.232 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:77: TEST_divergent: wait_for_clean 2026-02-13T20:09:35.233 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T20:09:35.233 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T20:09:35.233 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T20:09:35.233 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T20:09:35.234 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T20:09:35.234 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T20:09:35.234 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T20:09:35.234 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T20:09:35.234 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T20:09:35.332 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T20:09:35.332 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T20:09:35.332 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T20:09:35.332 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T20:09:35.332 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T20:09:35.333 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T20:09:35.540 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T20:09:35.540 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:09:35.540 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:09:35.540 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T20:09:35.540 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:09:35.541 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-13T20:09:35.625 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-13T20:09:35.625 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-13T20:09:35.625 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-13T20:09:35.626 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:09:35.626 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-13T20:09:35.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-13T20:09:35.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-13T20:09:35.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705670' 2026-02-13T20:09:35.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:09:35.711 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-13T20:09:35.791 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574855 2026-02-13T20:09:35.792 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574855 2026-02-13T20:09:35.792 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705670 2-55834574855' 2026-02-13T20:09:35.792 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:09:35.793 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-13T20:09:35.793 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:09:35.793 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-13T20:09:35.794 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-13T20:09:35.794 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:09:35.795 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-13T20:09:35.795 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-13T20:09:35.796 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836487 2026-02-13T20:09:35.796 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:09:36.008 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-13T20:09:36.008 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:09:36.008 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705670 2026-02-13T20:09:36.009 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:09:36.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-13T20:09:36.010 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-13T20:09:36.010 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:09:36.012 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705670 2026-02-13T20:09:36.012 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 38654705670 2026-02-13T20:09:36.012 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-13T20:09:36.012 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T20:09:36.232 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705670 -lt 38654705670 2026-02-13T20:09:36.232 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:09:36.233 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574855 2026-02-13T20:09:36.233 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:09:36.234 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-13T20:09:36.235 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574855 2026-02-13T20:09:36.235 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:09:36.236 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574855 2026-02-13T20:09:36.236 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 55834574855 2026-02-13T20:09:36.237 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574855' 2026-02-13T20:09:36.237 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:09:36.453 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574853 -lt 55834574855 2026-02-13T20:09:36.454 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:09:37.454 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T20:09:37.455 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:09:37.678 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574853 -lt 55834574855 2026-02-13T20:09:37.678 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:09:38.679 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-13T20:09:38.679 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:09:38.897 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574855 -lt 55834574855 2026-02-13T20:09:38.898 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T20:09:38.898 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:09:38.898 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:09:39.179 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T20:09:39.179 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:09:39.180 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:09:39.180 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:09:39.180 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:09:39.181 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:09:39.181 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:09:39.181 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:09:39.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-13T20:09:39.396 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:09:39.396 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:09:39.396 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:09:39.688 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-13T20:09:39.688 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T20:09:39.688 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T20:09:39.689 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: ceph pg dump pgs --format=json 2026-02-13T20:09:39.689 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: jq '.pg_stats[0].up_primary' 2026-02-13T20:09:39.894 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:09:39.904 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: local divergent=1 2026-02-13T20:09:39.904 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:81: TEST_divergent: echo 'primary and soon to be divergent is 1' 2026-02-13T20:09:39.904 INFO:tasks.workunit.client.0.trial030.stdout:primary and soon to be divergent is 1 2026-02-13T20:09:39.904 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:82: TEST_divergent: ceph pg dump pgs 2026-02-13T20:09:40.107 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:09:40.107 INFO:tasks.workunit.client.0.trial030.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T20:09:31.360919+0000 0'0 26:22 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:09:31.186436+0000 0'0 2026-02-13T20:09:31.186436+0000 0 0 periodic scrub scheduled @ 2026-02-15T08:06:28.608468+0000 0 0 2026-02-13T20:09:40.108 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:09:40.108 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:09:40.108 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:09:40.117 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:83: TEST_divergent: local non_divergent= 2026-02-13T20:09:40.117 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-13T20:09:40.117 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 0 = 1 ']' 2026-02-13T20:09:40.117 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: non_divergent=' 0' 2026-02-13T20:09:40.117 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-13T20:09:40.118 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 1 = 1 ']' 2026-02-13T20:09:40.118 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:87: TEST_divergent: continue 2026-02-13T20:09:40.118 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-13T20:09:40.118 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 2 = 1 ']' 2026-02-13T20:09:40.118 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: non_divergent=' 0 2' 2026-02-13T20:09:40.118 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:92: TEST_divergent: echo 'writing initial objects' 2026-02-13T20:09:40.118 INFO:tasks.workunit.client.0.trial030.stdout:writing initial objects 2026-02-13T20:09:40.119 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: seq 1 100 2026-02-13T20:09:40.119 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.119 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_1 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.140 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.140 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_2 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.169 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.170 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_3 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.197 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.197 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_4 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.225 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.226 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_5 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.253 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.253 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_6 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.280 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.280 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_7 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.308 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.308 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_8 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.337 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.337 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_9 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.364 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.364 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_10 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.392 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.392 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_11 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.420 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.420 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_12 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.449 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.449 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_13 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_14 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.504 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.504 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_15 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.532 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.533 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_16 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.560 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.560 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_17 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_18 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.617 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.617 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_19 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.645 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.645 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_20 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.673 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.673 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_21 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_22 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.728 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.729 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_23 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.756 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.756 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_24 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_25 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.814 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.814 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_26 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_27 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.869 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.869 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_28 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.897 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.897 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_29 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.925 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.925 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_30 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.953 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.953 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_31 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:40.981 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:40.981 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_32 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_33 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_34 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.065 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.065 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_35 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.093 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.093 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_36 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.122 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.122 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_37 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.150 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.150 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_38 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.177 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.177 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_39 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.205 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.205 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_40 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.233 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.233 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_41 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.261 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.261 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_42 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.289 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.289 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_43 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_44 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_45 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.373 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.373 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_46 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.401 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.401 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_47 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.429 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.429 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_48 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.457 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.458 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_49 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.486 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.486 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_50 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.514 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.514 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_51 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.542 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.542 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_52 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.569 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.570 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_53 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.598 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.598 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_54 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.626 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.626 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_55 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.656 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.656 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_56 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.685 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.685 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_57 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.713 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.713 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_58 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.741 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.741 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_59 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.768 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.768 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_60 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.797 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.797 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_61 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.825 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.825 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_62 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.853 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.853 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_63 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.880 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.880 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_64 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.901 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.901 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_65 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.929 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.929 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_66 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_67 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:41.985 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:41.985 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_68 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.013 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.013 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_69 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.041 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.042 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_70 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.069 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.070 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_71 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.097 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.097 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_72 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.125 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.125 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_73 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.152 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.152 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_74 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_75 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.209 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.209 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_76 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.237 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.237 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_77 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.265 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.265 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_78 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_79 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.314 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.314 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_80 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.341 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.341 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_81 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.369 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.369 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_82 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.397 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.397 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_83 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.417 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.417 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_84 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.446 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.446 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_85 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_86 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.497 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.497 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_87 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.525 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.525 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_88 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.552 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.552 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_89 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_90 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.608 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.608 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_91 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.636 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.636 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_92 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_93 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.692 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.692 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_94 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.721 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.721 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_95 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.750 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.750 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_96 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.778 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.778 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_97 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.806 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.806 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_98 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_99 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.861 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T20:09:42.862 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_100 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:42.890 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-13T20:09:42.890 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: wait_for_clean 2026-02-13T20:09:42.890 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T20:09:42.890 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T20:09:42.890 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T20:09:42.891 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-13T20:09:42.891 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T20:09:42.891 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T20:09:42.891 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T20:09:42.892 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T20:09:42.892 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T20:09:42.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-13T20:09:42.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T20:09:42.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T20:09:42.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T20:09:42.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T20:09:42.957 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T20:09:43.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T20:09:43.176 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:09:43.176 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:09:43.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T20:09:43.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:09:43.177 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-13T20:09:43.262 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-13T20:09:43.263 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-13T20:09:43.263 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491' 2026-02-13T20:09:43.263 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:09:43.263 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-13T20:09:43.347 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-13T20:09:43.347 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-13T20:09:43.347 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674' 2026-02-13T20:09:43.348 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:09:43.348 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-13T20:09:43.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574858 2026-02-13T20:09:43.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574858 2026-02-13T20:09:43.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-55834574858' 2026-02-13T20:09:43.428 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:09:43.428 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836491 2026-02-13T20:09:43.428 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:09:43.429 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-13T20:09:43.430 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-13T20:09:43.430 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:09:43.432 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836491 2026-02-13T20:09:43.432 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-13T20:09:43.432 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836491 2026-02-13T20:09:43.433 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:09:43.653 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836491 2026-02-13T20:09:43.653 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:09:44.654 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T20:09:44.655 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:09:44.869 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-13T20:09:44.869 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:09:44.869 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705674 2026-02-13T20:09:44.870 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:09:44.871 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-13T20:09:44.872 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-13T20:09:44.872 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:09:44.873 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705674 2026-02-13T20:09:44.873 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-13T20:09:44.873 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 38654705674 2026-02-13T20:09:44.873 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T20:09:45.092 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-13T20:09:45.092 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:09:45.093 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574858 2026-02-13T20:09:45.093 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:09:45.094 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-13T20:09:45.095 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574858 2026-02-13T20:09:45.095 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:09:45.097 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574858 2026-02-13T20:09:45.097 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574858' 2026-02-13T20:09:45.097 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 55834574858 2026-02-13T20:09:45.097 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:09:45.326 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574858 -lt 55834574858 2026-02-13T20:09:45.327 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T20:09:45.327 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:09:45.327 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:09:45.616 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T20:09:45.616 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:09:45.617 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:09:45.617 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:09:45.617 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:09:45.617 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:09:45.617 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:09:45.617 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:09:45.832 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-13T20:09:45.832 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:09:45.833 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:09:45.833 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:09:46.125 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-13T20:09:46.125 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T20:09:46.125 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T20:09:46.126 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:101: TEST_divergent: get_pg test existing_1 2026-02-13T20:09:46.126 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-13T20:09:46.126 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-13T20:09:46.126 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-13T20:09:46.126 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-13T20:09:46.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:101: TEST_divergent: local pgid=1.0 2026-02-13T20:09:46.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:104: TEST_divergent: echo 'blackholing osds 0 2' 2026-02-13T20:09:46.346 INFO:tasks.workunit.client.0.trial030.stdout:blackholing osds 0 2 2026-02-13T20:09:46.346 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:105: TEST_divergent: ceph pg dump pgs 2026-02-13T20:09:46.551 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:09:46.551 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-13T20:09:31.360919+0000 26'100 26:122 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:09:31.186436+0000 0'0 2026-02-13T20:09:31.186436+0000 0 0 periodic scrub scheduled @ 2026-02-15T08:06:28.608468+0000 0 0 2026-02-13T20:09:46.551 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:09:46.551 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:09:46.551 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:09:46.561 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:106: TEST_divergent: for i in $non_divergent 2026-02-13T20:09:46.562 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: get_asok_path osd.0 2026-02-13T20:09:46.562 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T20:09:46.562 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T20:09:46.563 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:09:46.563 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:09:46.563 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:09:46.563 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.0.asok 2026-02-13T20:09:46.563 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: CEPH_ARGS= 2026-02-13T20:09:46.563 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-13T20:09:46.618 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-13T20:09:46.618 INFO:tasks.workunit.client.0.trial030.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-13T20:09:46.618 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-13T20:09:46.624 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:106: TEST_divergent: for i in $non_divergent 2026-02-13T20:09:46.624 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: get_asok_path osd.2 2026-02-13T20:09:46.624 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-13T20:09:46.624 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-13T20:09:46.624 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:09:46.625 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:09:46.625 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:09:46.625 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.2.asok 2026-02-13T20:09:46.625 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: CEPH_ARGS= 2026-02-13T20:09:46.625 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-13T20:09:46.676 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-13T20:09:46.676 INFO:tasks.workunit.client.0.trial030.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-13T20:09:46.676 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-13T20:09:46.682 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:111: TEST_divergent: local case5=100 2026-02-13T20:09:46.682 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:112: TEST_divergent: expr 100 - 1 2026-02-13T20:09:46.683 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:112: TEST_divergent: local case3=99 2026-02-13T20:09:46.683 INFO:tasks.workunit.client.0.trial030.stdout:writing divergent object 2026-02-13T20:09:46.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:114: TEST_divergent: echo 'writing divergent object' 2026-02-13T20:09:46.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:116: TEST_divergent: echo 'create missing divergent object' 2026-02-13T20:09:46.684 INFO:tasks.workunit.client.0.trial030.stdout:create missing divergent object 2026-02-13T20:09:46.686 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:117: TEST_divergent: inject_eio rep data test existing_99 td/divergent-priors 0 2026-02-13T20:09:46.686 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-13T20:09:46.686 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:115: TEST_divergent: rados -p test put existing_100 /tmp/tmp.T5mBZmXxdw 2026-02-13T20:09:46.686 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-13T20:09:46.686 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=data 2026-02-13T20:09:46.686 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-13T20:09:46.686 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=test 2026-02-13T20:09:46.686 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-13T20:09:46.686 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=existing_99 2026-02-13T20:09:46.687 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-13T20:09:46.687 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/divergent-priors 2026-02-13T20:09:46.687 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-13T20:09:46.687 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=0 2026-02-13T20:09:46.687 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-13T20:09:46.687 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds test existing_99 2026-02-13T20:09:46.687 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=test 2026-02-13T20:09:46.687 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=existing_99 2026-02-13T20:09:46.687 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map test existing_99 2026-02-13T20:09:46.687 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T20:09:46.900 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-13T20:09:46.900 INFO:tasks.workunit.client.0.trial030.stderr:0 2026-02-13T20:09:46.900 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:09:46.900 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2 2026-02-13T20:09:46.900 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0' '2') 2026-02-13T20:09:46.900 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-13T20:09:46.900 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=1 2026-02-13T20:09:46.900 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-13T20:09:46.900 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-13T20:09:46.902 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/divergent-priors/1/type 2026-02-13T20:09:46.902 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-13T20:09:46.902 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-13T20:09:46.902 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-13T20:09:46.902 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-13T20:09:46.902 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-13T20:09:46.902 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-13T20:09:46.903 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-13T20:09:46.904 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-13T20:09:46.904 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T20:09:46.904 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T20:09:46.904 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:09:46.904 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:09:46.904 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:09:46.904 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.1.asok 2026-02-13T20:09:46.904 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.19555/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-13T20:09:46.966 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-13T20:09:46.966 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-13T20:09:46.967 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-13T20:09:46.967 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.1 2026-02-13T20:09:46.967 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T20:09:46.967 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T20:09:46.968 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:09:46.968 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:09:46.968 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:09:46.968 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.1.asok 2026-02-13T20:09:46.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-13T20:09:46.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.1.asok injectdataerr test existing_99 2026-02-13T20:09:47.027 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:119: TEST_divergent: sleep 10 2026-02-13T20:09:47.028 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:118: TEST_divergent: rados -p test get existing_99 td/divergent-priors/existing 2026-02-13T20:09:57.028 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:120: TEST_divergent: killall -9 rados 2026-02-13T20:09:57.068 INFO:tasks.workunit.client.0.trial030.stderr:rados: no process found 2026-02-13T20:09:57.069 INFO:tasks.workunit.client.0.trial030.stdout:killing all the osds 2026-02-13T20:09:57.069 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:123: TEST_divergent: echo 'killing all the osds' 2026-02-13T20:09:57.069 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:124: TEST_divergent: ceph pg dump pgs 2026-02-13T20:09:57.282 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:09:57.282 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 active+clean 2026-02-13T20:09:47.047480+0000 26'101 26:131 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:09:31.186436+0000 0'0 2026-02-13T20:09:31.186436+0000 0 0 periodic scrub scheduled @ 2026-02-15T08:06:28.608468+0000 0 0 2026-02-13T20:09:57.282 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:09:57.282 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:09:57.282 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:09:57.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:125: TEST_divergent: kill_daemons td/divergent-priors KILL osd 2026-02-13T20:09:57.291 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:09:57.291 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:09:57.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:09:57.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:09:57.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:09:57.400 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:09:57.400 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-13T20:09:57.400 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.0 2026-02-13T20:09:57.639 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already down. 2026-02-13T20:09:57.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-13T20:09:57.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.1 2026-02-13T20:09:57.943 INFO:tasks.workunit.client.0.trial030.stderr:osd.1 is already down. 2026-02-13T20:09:57.952 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-13T20:09:57.952 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.2 2026-02-13T20:09:58.228 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already down. 2026-02-13T20:09:58.239 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:130: TEST_divergent: for i in $non_divergent 2026-02-13T20:09:58.239 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:132: TEST_divergent: ceph osd out osd.0 2026-02-13T20:09:58.502 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already out. 2026-02-13T20:09:58.514 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:130: TEST_divergent: for i in $non_divergent 2026-02-13T20:09:58.514 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:132: TEST_divergent: ceph osd out osd.2 2026-02-13T20:09:58.775 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already out. 2026-02-13T20:09:58.786 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:136: TEST_divergent: echo 'bringing up non_divergent 0 2' 2026-02-13T20:09:58.786 INFO:tasks.workunit.client.0.trial030.stdout:bringing up non_divergent 0 2 2026-02-13T20:09:58.786 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:137: TEST_divergent: ceph pg dump pgs 2026-02-13T20:09:58.985 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:09:58.986 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 stale+active+clean 2026-02-13T20:09:47.047480+0000 26'101 26:131 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:09:31.186436+0000 0'0 2026-02-13T20:09:31.186436+0000 0 0 periodic scrub scheduled @ 2026-02-15T08:06:28.608468+0000 0 0 2026-02-13T20:09:58.986 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:09:58.986 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:09:58.986 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:09:58.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:138: TEST_divergent: for i in $non_divergent 2026-02-13T20:09:58.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:140: TEST_divergent: activate_osd td/divergent-priors 0 2026-02-13T20:09:58.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T20:09:58.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T20:09:58.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-13T20:09:58.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T20:09:58.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-13T20:09:58.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:09:58.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:09:58.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:09:58.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:09:58.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-13T20:09:58.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-13T20:09:58.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T20:09:58.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T20:09:58.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:09:58.997 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T20:09:58.997 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:09:58.997 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:09:58.998 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:09:58.998 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:09:58.998 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:09:58.998 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:09:58.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:09:58.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:09:58.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:09:58.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:09:58.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:09:58.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:09:58.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:09:58.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:09:58.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T20:09:58.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T20:09:58.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-13T20:09:58.999 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-13T20:09:58.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-13T20:09:59.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:09:59.000 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-13T20:09:59.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-13T20:09:59.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T20:09:59.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T20:09:59.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T20:09:59.022 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:59.013+0000 7f0f0475ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:59.024 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:59.017+0000 7f0f0475ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:59.025 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:59.017+0000 7f0f0475ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:09:59.219 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-13T20:09:59.220 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:09:59.220 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T20:09:59.220 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:09:59.220 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:09:59.220 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:09:59.220 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:09:59.220 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:09:59.220 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:09:59.220 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:09:59.439 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:09:59.488 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:09:59.481+0000 7f0f0475ca40 -1 Falling back to public interface 2026-02-13T20:10:00.139 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:10:00.133+0000 7f0f0475ca40 -1 osd.0 26 log_to_monitors true 2026-02-13T20:10:00.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:10:00.440 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:10:00.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:10:00.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:10:00.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:10:00.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:10:00.658 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up out weight 0 up_from 33 up_thru 0 down_at 27 last_clean_interval [5,26) [v2:127.0.0.1:6800/1654346493,v1:127.0.0.1:6801/1654346493] [v2:127.0.0.1:6802/1654346493,v1:127.0.0.1:6803/1654346493] exists,up 1051582f-4a18-4521-90d1-d9c240d69770 2026-02-13T20:10:00.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:10:00.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:10:00.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:10:00.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:138: TEST_divergent: for i in $non_divergent 2026-02-13T20:10:00.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:140: TEST_divergent: activate_osd td/divergent-priors 2 2026-02-13T20:10:00.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T20:10:00.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T20:10:00.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T20:10:00.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T20:10:00.659 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-13T20:10:00.659 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:10:00.659 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:10:00.659 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:10:00.659 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:10:00.659 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-13T20:10:00.659 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-13T20:10:00.659 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T20:10:00.659 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T20:10:00.659 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:10:00.659 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T20:10:00.659 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:10:00.659 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:10:00.659 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:10:00.659 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:10:00.659 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:10:00.659 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:10:00.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:10:00.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:10:00.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:10:00.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:10:00.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:10:00.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:10:00.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:10:00.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:10:00.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T20:10:00.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T20:10:00.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-13T20:10:00.661 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-13T20:10:00.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T20:10:00.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:10:00.661 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-13T20:10:00.662 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T20:10:00.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T20:10:00.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T20:10:00.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T20:10:00.683 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:10:00.673+0000 7f4e351a3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:10:00.684 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:10:00.677+0000 7f4e351a3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:10:00.685 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:10:00.677+0000 7f4e351a3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:10:00.876 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T20:10:00.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:10:00.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T20:10:00.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:10:00.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:10:00.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:10:00.877 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:10:00.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:10:00.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:10:00.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:10:01.072 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:10:01.065+0000 7f4e351a3a40 -1 Falling back to public interface 2026-02-13T20:10:01.097 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:10:01.792 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:10:01.785+0000 7f4e351a3a40 -1 osd.2 26 log_to_monitors true 2026-02-13T20:10:02.098 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:10:02.098 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:10:02.098 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:10:02.099 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:10:02.099 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:10:02.099 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:10:02.316 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up out weight 0 up_from 36 up_thru 0 down_at 29 last_clean_interval [13,26) [v2:127.0.0.1:6810/342389451,v1:127.0.0.1:6811/342389451] [v2:127.0.0.1:6812/342389451,v1:127.0.0.1:6813/342389451] exists,up b7ec0965-b075-4b83-8b19-41d4d417781c 2026-02-13T20:10:02.316 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:10:02.316 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:10:02.316 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:10:02.316 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:142: TEST_divergent: for i in $non_divergent 2026-02-13T20:10:02.316 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:144: TEST_divergent: ceph osd in osd.0 2026-02-13T20:10:02.561 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already in. 2026-02-13T20:10:02.571 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:142: TEST_divergent: for i in $non_divergent 2026-02-13T20:10:02.571 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:144: TEST_divergent: ceph osd in osd.2 2026-02-13T20:10:02.843 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already in. 2026-02-13T20:10:02.854 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-13T20:10:02.855 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: wait_for_clean 2026-02-13T20:10:02.855 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T20:10:02.855 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T20:10:02.855 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T20:10:02.855 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-13T20:10:02.856 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T20:10:02.856 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T20:10:02.856 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T20:10:02.856 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T20:10:02.856 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T20:10:02.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-13T20:10:02.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T20:10:02.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T20:10:02.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T20:10:02.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T20:10:02.913 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T20:10:03.133 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T20:10:03.134 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:10:03.134 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:10:03.134 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T20:10:03.134 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:10:03.134 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-13T20:10:03.218 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920771 2026-02-13T20:10:03.218 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920771 2026-02-13T20:10:03.219 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-141733920771' 2026-02-13T20:10:03.219 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:10:03.219 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-13T20:10:03.281 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-13T20:10:03.281 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-13T20:10:03.281 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-13T20:10:03.281 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-13T20:10:03.281 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:10:03.281 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-13T20:10:03.360 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822659 2026-02-13T20:10:03.360 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822659 2026-02-13T20:10:03.360 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-141733920771 2-154618822659' 2026-02-13T20:10:03.360 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:10:03.361 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-141733920771 2026-02-13T20:10:03.361 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:10:03.362 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-13T20:10:03.363 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-141733920771 2026-02-13T20:10:03.363 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:10:03.364 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=141733920771 2026-02-13T20:10:03.364 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 141733920771 2026-02-13T20:10:03.364 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 141733920771' 2026-02-13T20:10:03.365 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:10:03.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 141733920771 2026-02-13T20:10:03.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:10:04.590 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T20:10:04.590 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:10:04.810 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 141733920771 -lt 141733920771 2026-02-13T20:10:04.810 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:10:04.811 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-154618822659 2026-02-13T20:10:04.811 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:10:04.812 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-13T20:10:04.813 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-154618822659 2026-02-13T20:10:04.813 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:10:04.815 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822659 2026-02-13T20:10:04.815 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 154618822659 2026-02-13T20:10:04.816 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 154618822659' 2026-02-13T20:10:04.816 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:10:05.048 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822659 -lt 154618822659 2026-02-13T20:10:05.049 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T20:10:05.049 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:10:05.049 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:10:05.338 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T20:10:05.338 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:10:05.338 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:10:05.338 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:10:05.338 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:10:05.338 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:10:05.338 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:10:05.338 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:10:05.558 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:10:05.558 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:10:05.559 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:10:05.559 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:10:05.872 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:10:05.872 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-13T20:10:05.872 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-13T20:10:05.872 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-13T20:10:05.872 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:10:05.873 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-13T20:10:05.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:10:05.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:10:05.974 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:10:05.974 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:10:05.974 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:10:05.974 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:10:05.975 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:10:05.975 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:10:06.183 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:10:06.184 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:10:06.184 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:10:06.184 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:10:06.473 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:10:06.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:10:06.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:10:06.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:10:06.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:10:06.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:10:06.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:10:06.474 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:10:06.474 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:10:06.756 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:10:06.756 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:10:06.756 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-13T20:10:06.756 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:10:06.756 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-13T20:10:06.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:10:06.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:10:06.958 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:10:06.958 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:10:06.958 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:10:06.958 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:10:06.958 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:10:06.958 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:10:07.160 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:10:07.161 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:10:07.161 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:10:07.161 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:10:07.436 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:10:07.436 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:10:07.436 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:10:07.436 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:10:07.437 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:10:07.437 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:10:07.437 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:10:07.437 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:10:07.437 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:10:07.714 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:10:07.714 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:10:07.714 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-13T20:10:07.714 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:10:07.714 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-13T20:10:08.115 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:10:08.115 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:10:08.115 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:10:08.116 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:10:08.116 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:10:08.116 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:10:08.116 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:10:08.116 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:10:08.337 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:10:08.337 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:10:08.337 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:10:08.338 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:10:08.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:10:08.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:10:08.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:10:08.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:10:08.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:10:08.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:10:08.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:10:08.633 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:10:08.633 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:10:08.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:10:08.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:10:08.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-13T20:10:08.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:10:08.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-13T20:10:09.719 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:10:09.719 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:10:09.720 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:10:09.720 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:10:09.720 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:10:09.720 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:10:09.720 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:10:09.720 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:10:09.938 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:10:09.939 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:10:09.939 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:10:09.940 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:10:10.233 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:10:10.233 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:10:10.233 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:10:10.233 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:10:10.233 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:10:10.233 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:10:10.233 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:10:10.233 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:10:10.233 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:10:10.522 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:10:10.522 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:10:10.522 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-13T20:10:10.522 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:10:10.522 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-13T20:10:12.124 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:10:12.124 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:10:12.125 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:10:12.125 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:10:12.125 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:10:12.125 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:10:12.125 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:10:12.125 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:10:12.346 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:10:12.346 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:10:12.346 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:10:12.346 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:10:12.627 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:10:12.627 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:10:12.627 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:10:12.627 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:10:12.627 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:10:12.627 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:10:12.627 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:10:12.628 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:10:12.628 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:10:12.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:10:12.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:10:12.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-13T20:10:12.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:10:12.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-13T20:10:16.126 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:10:16.126 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:10:16.126 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:10:16.126 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:10:16.126 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:10:16.126 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:10:16.127 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:10:16.127 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:10:16.346 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:10:16.346 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:10:16.346 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:10:16.346 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:10:16.639 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:10:16.639 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:10:16.639 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:10:16.639 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:10:16.639 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:10:16.639 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:10:16.639 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:10:16.639 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:10:16.639 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:10:16.923 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:10:16.923 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:10:16.923 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-13T20:10:16.923 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:10:16.923 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-13T20:10:23.324 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:10:23.324 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:10:23.325 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:10:23.325 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:10:23.325 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:10:23.325 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:10:23.325 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:10:23.325 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:10:23.547 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:10:23.547 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:10:23.548 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:10:23.548 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:10:23.833 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:10:23.833 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:10:23.833 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:10:23.833 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:10:23.833 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:10:23.833 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:10:23.833 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:10:23.833 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:10:23.833 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:10:24.108 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:10:24.108 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:10:24.108 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-13T20:10:24.108 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:10:24.108 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-13T20:10:31.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:10:31.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:10:31.409 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:10:31.409 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:10:31.409 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:10:31.410 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:10:31.410 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:10:31.410 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:10:31.620 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:10:31.620 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:10:31.621 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:10:31.621 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:10:31.904 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:10:31.905 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:10:31.905 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:10:31.905 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:10:31.905 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:10:31.905 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:10:31.905 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:10:31.905 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:10:31.905 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:10:32.182 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:10:32.182 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:10:32.182 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-13T20:10:32.182 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-13T20:10:32.457 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-13T20:10:32.457 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_fingerprint": "eb1cf427-fd21-4000-9599-f93145c6fee6", 2026-02-13T20:10:32.457 INFO:tasks.workunit.client.0.trial030.stdout: "version": "20.3.0-5230-gafefaa40", 2026-02-13T20:10:32.457 INFO:tasks.workunit.client.0.trial030.stdout: "commit": "afefaa40503a4bf024e96f97dd7f852b75f00ad6", 2026-02-13T20:10:32.457 INFO:tasks.workunit.client.0.trial030.stdout: "timestamp": "2026-02-13T20:10:32.454364+0000", 2026-02-13T20:10:32.457 INFO:tasks.workunit.client.0.trial030.stdout: "tag": "", 2026-02-13T20:10:32.457 INFO:tasks.workunit.client.0.trial030.stdout: "health": { 2026-02-13T20:10:32.457 INFO:tasks.workunit.client.0.trial030.stdout: "status": "HEALTH_WARN", 2026-02-13T20:10:32.457 INFO:tasks.workunit.client.0.trial030.stdout: "checks": { 2026-02-13T20:10:32.457 INFO:tasks.workunit.client.0.trial030.stdout: "OSDMAP_FLAGS": { 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "count": 17 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [], 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "OSD_DOWN": { 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "message": "1 osds down", 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "message": "osd.1 (root=default,host=trial030) is down" 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "PG_DEGRADED": { 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "mutes": [] 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_first_committed": 1, 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_last_committed": 1, 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "monmap": { 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "76a1de22-3326-43d1-82f4-48cedec81b31", 2026-02-13T20:10:32.458 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-13T20:09:19.130626Z", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-13T20:09:19.130626Z", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release": 20, 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "election_strategy": 1, 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "disallowed_leaders": "", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": false, 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "tiebreaker_mon": "", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "removed_ranks": "", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "features": { 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "persistent": [ 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "kraken", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "luminous", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "mimic", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap-prune", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "nautilus", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "octopus", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "pacific", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "elector-pinging", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "quincy", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "reef", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "squid", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "tentacle", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "nvmeof_beacon_diff" 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "optional": [] 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "mons": [ 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "rank": 0, 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "name": "a", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 0 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115/0", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "priority": 0, 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 0, 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "time_added": "2026-02-13T20:09:19:130624+0000", 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: "crush_location": [] 2026-02-13T20:10:32.459 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "quorum": [ 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: 0 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap": { 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 39, 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "76a1de22-3326-43d1-82f4-48cedec81b31", 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-13T20:09:19.218218+0000", 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-13T20:10:02.888740+0000", 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "last_up_change": "2026-02-13T20:10:01.991936+0000", 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "last_in_change": "2026-02-13T20:10:02.786153+0000", 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "flags_num": 5800384, 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "flags_set": [ 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "nodown", 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "noin", 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "noout", 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "pglog_hardlimit", 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snapdirs", 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "recovery_deletes", 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "sortbitwise" 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "crush_version": 9, 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "full_ratio": 0.99000000953674316, 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_snapshot": "", 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "pool_max": 1, 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "max_osd": 3, 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "require_min_compat_client": "luminous", 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "min_compat_client": "jewel", 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "require_osd_release": "tentacle", 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "allow_crimson": false, 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "pools": [ 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "pool_name": "test", 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "create_time": "2026-02-13T20:09:31.158653+0000", 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "flags": 1, 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "flags_names": "hashpspool", 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "size": 3, 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "min_size": 2, 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "crush_rule": 0, 2026-02-13T20:10:32.460 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_count": 0, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_target": 0, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_barrier": 0, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "is_stretch_pool": false, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "object_hash": 2, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "pg_autoscale_mode": "off", 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num": 1, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num": 1, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num_target": 1, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_target": 1, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_pending": 1, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "last_pg_merge_meta": { 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "source_pgid": "0.0", 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "ready_epoch": 0, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_started": 0, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": 0, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "source_version": "0'0", 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "target_version": "0'0" 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "last_change": "26", 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend": "0", 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_preluminous": "0", 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "auid": 0, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "snap_mode": "selfmanaged", 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "snap_seq": 0, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "snap_epoch": 0, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "pool_snaps": [], 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps": "[]", 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_bytes": 0, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_objects": 0, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "tiers": [], 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "tier_of": -1, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "read_tier": -1, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "write_tier": -1, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "cache_mode": "none", 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_bytes": 0, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_objects": 0, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_flush_age": 0, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_evict_age": 0, 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profile": "", 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_params": { 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: "type": "none" 2026-02-13T20:10:32.461 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_period": 0, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_count": 0, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "use_gmt_hitset": true, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "min_read_recency_for_promote": 0, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "min_write_recency_for_promote": 0, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_grade_decay_rate": 0, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_search_last_n": 0, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "grade_table": [], 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "stripe_width": 0, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "expected_num_objects": 0, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "fast_read": false, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "nonprimary_shards": "{}", 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "options": {}, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "application_metadata": {}, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "read_balance": { 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "score_type": "Fair distribution", 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "score_acting": 2.9900000095367432, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "score_stable": 2.9900000095367432, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_score": 0.67000001668930054, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "raw_score_acting": 2, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "raw_score_stable": 2, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity_weighted": 1, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "average_primary_affinity": 1, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "average_primary_affinity_weighted": 1 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "osds": [ 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "1051582f-4a18-4521-90d1-d9c240d69770", 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 5, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 26, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 33, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 38, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 27, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6800", 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1654346493 2026-02-13T20:10:32.462 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6801", 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1654346493 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6802", 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1654346493 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6803", 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1654346493 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6806", 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1654346493 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6807", 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1654346493 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6804", 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1654346493 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6805", 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1654346493 2026-02-13T20:10:32.463 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6801/1654346493", 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6803/1654346493", 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6807/1654346493", 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6805/1654346493", 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "4d94185d-eb34-4aae-ab55-fc37e2d7eea1", 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "up": 0, 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 0, 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 0, 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 9, 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 20, 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 28, 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1623357314 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1623357314 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1623357314 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:10:32.464 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1623357314 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1623357314 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1623357314 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1623357314 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1623357314 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/1623357314", 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/1623357314", 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1623357314", 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1623357314", 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "exists" 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "b7ec0965-b075-4b83-8b19-41d4d417781c", 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-13T20:10:32.465 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 13, 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 26, 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 36, 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 0, 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 29, 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 342389451 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 342389451 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 342389451 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 342389451 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 342389451 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 342389451 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.466 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 342389451 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 342389451 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/342389451", 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/342389451", 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/342389451", 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/342389451", 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "osd_xinfo": [ 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-13T20:09:57.580121+0000", 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-13T20:09:22.530562+0000", 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-13T20:09:57.881657+0000", 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.467 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-13T20:09:58.171642+0000", 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-13T20:09:29.388734+0000", 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap": [], 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_items": [], 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_primaries": [], 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "pg_temp": [], 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "primary_temp": [], 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "blocklist": {}, 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "range_blocklist": {}, 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profiles": { 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "default": { 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "k": "2", 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "m": "2", 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "plugin": "isa", 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "technique": "reed_sol_van" 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps_queue": [], 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "new_removed_snaps": [], 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "new_purged_snaps": [], 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "crush_node_flags": {}, 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "device_class_flags": {}, 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": { 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_enabled": false, 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_bucket_count": 0, 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "degraded_stretch_mode": 0, 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "recovering_stretch_mode": 0, 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_bucket": 0 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "osd_metadata": [ 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6802/1654346493,v1:127.0.0.1:6803/1654346493]", 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-13T20:10:32.468 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-13T20:09:20.166990Z", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6800/1654346493,v1:127.0.0.1:6801/1654346493]", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/1654346493,v1:127.0.0.1:6807/1654346493]", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/1654346493,v1:127.0.0.1:6805/1654346493]", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961704", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/0", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-13T20:10:32.469 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/1623357314,v1:127.0.0.1:6813/1623357314]", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-13T20:09:23.843976Z", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/1623357314,v1:127.0.0.1:6811/1623357314]", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1623357314,v1:127.0.0.1:6817/1623357314]", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1623357314,v1:127.0.0.1:6815/1623357314]", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T20:10:32.470 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961704", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/1", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/342389451,v1:127.0.0.1:6813/342389451]", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-13T20:09:26.711676Z", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-13T20:10:32.471 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/342389451,v1:127.0.0.1:6811/342389451]", 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/342389451,v1:127.0.0.1:6817/342389451]", 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/342389451,v1:127.0.0.1:6815/342389451]", 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961704", 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/2", 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_clean_epochs": { 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "min_last_epoch_clean": 0, 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": { 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "per_pool": [] 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "osd_epochs": [ 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 33 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 37 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_first_committed": 1, 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_last_committed": 39, 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "crushmap": { 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "devices": [ 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:10:32.472 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.0", 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.1", 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.2", 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "types": [ 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 0, 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd" 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "name": "host" 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 2, 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "name": "chassis" 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 3, 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "name": "rack" 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 4, 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "name": "row" 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 5, 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pdu" 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 6, 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pod" 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 7, 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: "name": "room" 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.473 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 8, 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "name": "datacenter" 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 9, 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "name": "zone" 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 10, 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "name": "region" 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "name": "root" 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "buckets": [ 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "id": -1, 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default", 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "id": -2, 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default~ssd", 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.474 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030", 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030~ssd", 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.475 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "rules": [ 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "rule_id": 0, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "rule_name": "replicated_rule", 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "steps": [ 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "op": "take", 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "item": -1, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "item_name": "default" 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "op": "choose_firstn", 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "num": 0, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "type": "osd" 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "op": "emit" 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "tunables": { 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_tries": 0, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_fallback_tries": 0, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "choose_total_tries": 50, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_descend_once": 1, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_vary_r": 1, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_stable": 1, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "msr_descents": 100, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "msr_collision_tries": 100, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "straw_calc_version": 1, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "allowed_bucket_algs": 54, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "profile": "jewel", 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_tunables": 1, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "legacy_tunables": 0, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "minimum_required_version": "jewel", 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables": 1, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables2": 1, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "has_v2_rules": 0, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables3": 1, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "has_v3_rules": 0, 2026-02-13T20:10:32.476 INFO:tasks.workunit.client.0.trial030.stdout: "has_v4_buckets": 1, 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables5": 1, 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "has_v5_rules": 0, 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "has_msr_rules": 0 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "choose_args": {} 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stderr:report 965522521 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "fsmap": { 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "btime": "2026-02-13T20:09:19:218005+0000", 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "default_fscid": -1, 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "compat": { 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "compat": {}, 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "ro_compat": {}, 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "incompat": { 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "feature_1": "base v0.20", 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "feature_2": "client writeable ranges", 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "feature_3": "default file layouts on dirs", 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "feature_4": "dir inode in separate object", 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "feature_5": "mds uses versioned encoding", 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "feature_8": "no anchor table", 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "feature_9": "file layout v2", 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "feature_10": "snaprealm v2", 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "feature_11": "minor log segments", 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "feature_12": "quiesce subvolumes" 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "feature_flags": { 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "enable_multiple": true, 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "ever_enabled_multiple": true 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.477 INFO:tasks.workunit.client.0.trial030.stdout: "standbys": [], 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "filesystems": [] 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_first_committed": 1, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_last_committed": 1, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "auth": { 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 5, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_secrets": 3 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 1, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_active": 1, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_unknown": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_osd": 3, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "pool_sum": { 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 51200, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 100, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 300, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 100, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 100, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 100, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 100, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-13T20:10:32.478 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 0, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 0, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 16, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 16, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "up": 2, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 2, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 0 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum": { 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 3, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83836, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2056, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 26, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81701, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488964, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036699136, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2105344, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 415682, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:10:32.479 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 26699, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83662773 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 1, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum_by_class": { 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "ssd": { 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 3, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83836, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2056, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 26, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81701, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488964, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036699136, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2105344, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 415682, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 26699, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83662773 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-13T20:10:32.480 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 1, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "pool_stats": [ 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": 1, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 1, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 51200, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 100, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 300, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 100, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 100, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 100, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 100, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-13T20:10:32.481 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 1228800, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 153600, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 16, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 16, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "up": 2, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 2, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 3 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "osd_stats": [ 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 141733920777 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 38654705677 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 154618822664 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:10:32.482 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_state": [ 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "state": "active+undersized+degraded", 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "num": 1 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "pool_pg_unavailable_map": [ 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": "1", 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "pgs": [] 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_osd": [ 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 1, 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 0, 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": [ 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": {} 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "servicemap": { 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 3, 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-13T20:10:27.742151+0000", 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "services": { 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "osd": { 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "daemons": { 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "summary": "", 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "0": { 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "start_epoch": 0, 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "start_stamp": "0.000000", 2026-02-13T20:10:32.483 INFO:tasks.workunit.client.0.trial030.stdout: "gid": 0, 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: "metadata": {}, 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: "task_status": {} 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: "2": { 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: "start_epoch": 0, 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: "start_stamp": "0.000000", 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: "gid": 0, 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: "metadata": {}, 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: "task_status": {} 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_first_committed": 1, 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_last_committed": 37, 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: "logm_first_committed": 1, 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: "logm_last_committed": 217, 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: "paxos": { 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 304, 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: "last_pn": 0, 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: "accepted_pn": 0 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: expr 2 + 2 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: objname=existing_4 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:151: TEST_divergent: echo 'writing non-divergent object existing_4' 2026-02-13T20:10:32.484 INFO:tasks.workunit.client.0.trial030.stdout:writing non-divergent object existing_4 2026-02-13T20:10:32.485 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:152: TEST_divergent: ceph pg dump pgs 2026-02-13T20:10:32.668 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:10:32.668 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:10:02.891600+0000 26'100 39:130 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:09:31.186436+0000 0'0 2026-02-13T20:09:31.186436+0000 0 0 periodic scrub scheduled @ 2026-02-14T20:48:39.898361+0000 0 0 2026-02-13T20:10:32.669 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:10:32.669 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:10:32.669 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:10:32.677 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:154: TEST_divergent: dd if=/dev/urandom bs=1000 count=1 2026-02-13T20:10:32.677 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:154: TEST_divergent: rados -p test put existing_4 - 2026-02-13T20:10:32.678 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records in 2026-02-13T20:10:32.678 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records out 2026-02-13T20:10:32.678 INFO:tasks.workunit.client.0.trial030.stderr:1000 bytes (1.0 kB) copied, 1.8734e-05 s, 53.4 MB/s 2026-02-13T20:10:32.699 INFO:tasks.workunit.client.0.trial030.stdout:delay recovery 2026-02-13T20:10:32.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:157: TEST_divergent: echo 'delay recovery' 2026-02-13T20:10:32.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:158: TEST_divergent: ceph pg dump pgs 2026-02-13T20:10:32.896 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:10:32.896 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:10:02.891600+0000 26'100 39:130 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:09:31.186436+0000 0'0 2026-02-13T20:09:31.186436+0000 0 0 periodic scrub scheduled @ 2026-02-14T20:48:39.898361+0000 0 0 2026-02-13T20:10:32.896 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:10:32.896 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:10:32.896 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:10:32.904 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:159: TEST_divergent: for i in $non_divergent 2026-02-13T20:10:32.905 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: get_asok_path osd.0 2026-02-13T20:10:32.905 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T20:10:32.906 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T20:10:32.906 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:10:32.906 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:10:32.906 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:10:32.906 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.0.asok 2026-02-13T20:10:32.907 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: CEPH_ARGS= 2026-02-13T20:10:32.907 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.0.asok set_recovery_delay 100000 2026-02-13T20:10:32.961 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T20:10:32.966 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:159: TEST_divergent: for i in $non_divergent 2026-02-13T20:10:32.967 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: get_asok_path osd.2 2026-02-13T20:10:32.967 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-13T20:10:32.967 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-13T20:10:32.967 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:10:32.967 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:10:32.967 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:10:32.967 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.2.asok 2026-02-13T20:10:32.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: CEPH_ARGS= 2026-02-13T20:10:32.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.2.asok set_recovery_delay 100000 2026-02-13T20:10:33.023 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T20:10:33.028 INFO:tasks.workunit.client.0.trial030.stdout:revive divergent 1 2026-02-13T20:10:33.028 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:165: TEST_divergent: echo 'revive divergent 1' 2026-02-13T20:10:33.029 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:166: TEST_divergent: ceph pg dump pgs 2026-02-13T20:10:33.238 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:10:33.239 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:10:02.891600+0000 26'100 39:130 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:09:31.186436+0000 0'0 2026-02-13T20:09:31.186436+0000 0 0 periodic scrub scheduled @ 2026-02-14T20:48:39.898361+0000 0 0 2026-02-13T20:10:33.239 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:10:33.239 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:10:33.239 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:10:33.247 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:167: TEST_divergent: ceph osd set noup 2026-02-13T20:10:33.574 INFO:tasks.workunit.client.0.trial030.stderr:noup is set 2026-02-13T20:10:33.590 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:168: TEST_divergent: activate_osd td/divergent-priors 1 2026-02-13T20:10:33.590 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T20:10:33.590 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T20:10:33.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T20:10:33.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T20:10:33.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-13T20:10:33.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:10:33.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:10:33.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:10:33.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:10:33.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T20:10:33.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T20:10:33.592 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T20:10:33.592 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T20:10:33.592 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:10:33.592 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T20:10:33.592 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:10:33.592 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:10:33.592 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:10:33.592 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:10:33.592 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:10:33.592 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:10:33.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:10:33.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:10:33.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:10:33.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:10:33.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:10:33.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:10:33.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:10:33.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:10:33.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T20:10:33.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T20:10:33.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-13T20:10:33.594 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-13T20:10:33.595 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T20:10:33.595 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:10:33.595 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-13T20:10:33.595 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T20:10:33.596 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T20:10:33.596 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T20:10:33.596 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T20:10:33.614 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:10:33.608+0000 7f41a9ca7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:10:33.615 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:10:33.612+0000 7f41a9ca7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:10:33.616 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:10:33.612+0000 7f41a9ca7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:10:33.808 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-13T20:10:33.808 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:169: TEST_divergent: sleep 5 2026-02-13T20:10:33.969 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:10:33.964+0000 7f41a9ca7a40 -1 Falling back to public interface 2026-02-13T20:10:34.619 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:10:34.612+0000 7f41a9ca7a40 -1 osd.1 26 log_to_monitors true 2026-02-13T20:10:38.809 INFO:tasks.workunit.client.0.trial030.stdout:delay recovery divergent 2026-02-13T20:10:38.810 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:171: TEST_divergent: echo 'delay recovery divergent' 2026-02-13T20:10:38.810 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:172: TEST_divergent: ceph pg dump pgs 2026-02-13T20:10:39.010 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:10:39.010 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-13T20:10:02.891600+0000 39'101 42:137 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:09:31.186436+0000 0'0 2026-02-13T20:09:31.186436+0000 0 0 periodic scrub scheduled @ 2026-02-14T20:48:39.898361+0000 0 0 2026-02-13T20:10:39.010 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:10:39.010 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:10:39.011 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:10:39.019 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: get_asok_path osd.1 2026-02-13T20:10:39.019 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T20:10:39.019 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T20:10:39.019 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:10:39.019 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:10:39.020 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:10:39.020 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.1.asok 2026-02-13T20:10:39.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: CEPH_ARGS= 2026-02-13T20:10:39.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.1.asok set_recovery_delay 100000 2026-02-13T20:10:39.076 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T20:10:39.081 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:175: TEST_divergent: ceph osd unset noup 2026-02-13T20:10:39.409 INFO:tasks.workunit.client.0.trial030.stderr:noup is unset 2026-02-13T20:10:39.421 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:177: TEST_divergent: wait_for_osd up 0 2026-02-13T20:10:39.421 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:10:39.421 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T20:10:39.421 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:10:39.421 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:10:39.421 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:10:39.421 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:10:39.422 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:10:39.422 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:10:39.422 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:10:39.636 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 33 up_thru 38 down_at 27 last_clean_interval [5,26) [v2:127.0.0.1:6800/1654346493,v1:127.0.0.1:6801/1654346493] [v2:127.0.0.1:6802/1654346493,v1:127.0.0.1:6803/1654346493] exists,up 1051582f-4a18-4521-90d1-d9c240d69770 2026-02-13T20:10:39.637 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:10:39.637 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:10:39.637 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:10:39.637 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:178: TEST_divergent: wait_for_osd up 1 2026-02-13T20:10:39.637 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:10:39.637 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T20:10:39.637 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:10:39.637 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:10:39.637 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:10:39.637 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:10:39.637 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:10:39.637 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:10:39.637 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:10:39.854 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 44 up_thru 44 down_at 28 last_clean_interval [9,26) [v2:127.0.0.1:6818/3945267899,v1:127.0.0.1:6819/3945267899] [v2:127.0.0.1:6820/3945267899,v1:127.0.0.1:6821/3945267899] exists,up 4d94185d-eb34-4aae-ab55-fc37e2d7eea1 2026-02-13T20:10:39.855 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:10:39.855 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:10:39.855 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:10:39.855 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:179: TEST_divergent: wait_for_osd up 2 2026-02-13T20:10:39.856 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:10:39.856 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T20:10:39.856 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:10:39.856 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:10:39.856 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:10:39.856 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:10:39.857 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:10:39.857 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:10:39.857 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:10:40.074 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 36 up_thru 0 down_at 29 last_clean_interval [13,26) [v2:127.0.0.1:6810/342389451,v1:127.0.0.1:6811/342389451] [v2:127.0.0.1:6812/342389451,v1:127.0.0.1:6813/342389451] exists,up b7ec0965-b075-4b83-8b19-41d4d417781c 2026-02-13T20:10:40.075 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:10:40.075 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:10:40.075 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:10:40.075 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:181: TEST_divergent: ceph pg dump pgs 2026-02-13T20:10:40.281 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:10:40.282 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 2 2 0 0 51688 0 0 17 84 17 active+recovering+degraded 2026-02-13T20:10:39.514170+0000 39'101 45:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:09:31.186436+0000 0'0 2026-02-13T20:09:31.186436+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:10:40.282 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:10:40.282 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:10:40.282 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:10:40.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:182: TEST_divergent: echo 'wait for peering' 2026-02-13T20:10:40.292 INFO:tasks.workunit.client.0.trial030.stdout:wait for peering 2026-02-13T20:10:40.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:183: TEST_divergent: ceph pg dump pgs 2026-02-13T20:10:40.490 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:10:40.491 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 2 2 0 0 51688 0 0 17 84 17 active+recovering+degraded 2026-02-13T20:10:39.514170+0000 39'101 45:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:09:31.186436+0000 0'0 2026-02-13T20:09:31.186436+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:10:40.491 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:10:40.491 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:10:40.491 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:10:40.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:184: TEST_divergent: rados -p test put foo /tmp/tmp.T5mBZmXxdw 2026-02-13T20:10:40.522 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:186: TEST_divergent: echo 'killing divergent 1' 2026-02-13T20:10:40.523 INFO:tasks.workunit.client.0.trial030.stdout:killing divergent 1 2026-02-13T20:10:40.523 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:187: TEST_divergent: ceph pg dump pgs 2026-02-13T20:10:40.732 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:10:40.732 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 2 2 0 0 51688 0 0 17 84 17 active+recovering+degraded 2026-02-13T20:10:39.514170+0000 39'101 45:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:09:31.186436+0000 0'0 2026-02-13T20:09:31.186436+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:10:40.732 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:10:40.732 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:10:40.732 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:10:40.741 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:188: TEST_divergent: kill_daemons td/divergent-priors KILL osd.1 2026-02-13T20:10:40.741 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:10:40.741 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:10:40.742 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:10:40.742 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:10:40.742 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:10:40.849 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:10:40.850 INFO:tasks.workunit.client.0.trial030.stdout:reviving divergent 1 2026-02-13T20:10:40.850 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:190: TEST_divergent: echo 'reviving divergent 1' 2026-02-13T20:10:40.851 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:191: TEST_divergent: ceph pg dump pgs 2026-02-13T20:10:41.050 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:10:41.050 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 2 2 0 0 51688 0 0 17 84 17 active+recovering+degraded 2026-02-13T20:10:39.514170+0000 39'101 45:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:09:31.186436+0000 0'0 2026-02-13T20:09:31.186436+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:10:41.050 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:10:41.050 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:10:41.051 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:10:41.061 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:192: TEST_divergent: activate_osd td/divergent-priors 1 2026-02-13T20:10:41.061 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T20:10:41.061 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T20:10:41.061 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T20:10:41.061 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T20:10:41.061 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-13T20:10:41.061 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:10:41.061 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:10:41.061 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:10:41.061 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:10:41.061 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T20:10:41.062 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T20:10:41.062 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T20:10:41.062 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T20:10:41.062 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:10:41.062 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T20:10:41.062 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:10:41.062 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:10:41.062 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:10:41.062 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:10:41.062 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:10:41.062 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:10:41.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:10:41.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:10:41.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:10:41.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:10:41.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:10:41.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:10:41.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:10:41.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:10:41.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T20:10:41.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T20:10:41.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-13T20:10:41.064 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-13T20:10:41.064 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T20:10:41.064 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:10:41.065 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-13T20:10:41.066 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T20:10:41.066 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T20:10:41.066 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T20:10:41.066 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T20:10:41.087 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:10:41.080+0000 7fe52e896a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:10:41.089 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:10:41.084+0000 7fe52e896a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:10:41.090 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:10:41.084+0000 7fe52e896a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:10:41.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-13T20:10:41.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:10:41.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T20:10:41.288 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:10:41.288 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:10:41.288 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:10:41.288 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:10:41.288 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:10:41.289 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:10:41.289 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:10:41.515 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 44 up_thru 44 down_at 28 last_clean_interval [9,26) [v2:127.0.0.1:6818/3945267899,v1:127.0.0.1:6819/3945267899] [v2:127.0.0.1:6820/3945267899,v1:127.0.0.1:6821/3945267899] exists,up 4d94185d-eb34-4aae-ab55-fc37e2d7eea1 2026-02-13T20:10:41.516 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:10:41.516 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:10:41.516 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:10:41.516 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:194: TEST_divergent: sleep 20 2026-02-13T20:10:41.569 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:10:41.564+0000 7fe52e896a40 -1 Falling back to public interface 2026-02-13T20:10:42.167 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:10:42.160+0000 7fe52e896a40 -1 osd.1 46 log_to_monitors true 2026-02-13T20:11:01.517 INFO:tasks.workunit.client.0.trial030.stdout:allowing recovery 2026-02-13T20:11:01.517 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:196: TEST_divergent: echo 'allowing recovery' 2026-02-13T20:11:01.518 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:197: TEST_divergent: ceph pg dump pgs 2026-02-13T20:11:01.719 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:11:01.719 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 0 0 0 0 52200 0 0 18 84 18 active+clean 2026-02-13T20:10:43.510331+0000 46'102 50:161 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:09:31.186436+0000 0'0 2026-02-13T20:09:31.186436+0000 0 0 periodic scrub scheduled @ 2026-02-14T21:10:08.481796+0000 0 0 2026-02-13T20:11:01.720 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:11:01.720 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:11:01.720 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:11:01.729 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-13T20:11:01.730 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-13T20:11:01.805 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T20:11:01.813 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-13T20:11:01.813 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-13T20:11:01.884 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T20:11:01.891 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-13T20:11:01.892 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-13T20:11:01.964 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T20:11:01.971 INFO:tasks.workunit.client.0.trial030.stdout:reading divergent objects 2026-02-13T20:11:01.971 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:204: TEST_divergent: echo 'reading divergent objects' 2026-02-13T20:11:01.971 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:205: TEST_divergent: ceph pg dump pgs 2026-02-13T20:11:02.186 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:11:02.187 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 0 0 0 0 52200 0 0 18 84 18 active+clean 2026-02-13T20:10:43.510331+0000 46'102 50:161 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:09:31.186436+0000 0'0 2026-02-13T20:09:31.186436+0000 0 0 periodic scrub scheduled @ 2026-02-14T21:10:08.481796+0000 0 0 2026-02-13T20:11:02.187 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:11:02.187 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:11:02.187 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:11:02.196 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: expr 2 + 2 2026-02-13T20:11:02.197 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: seq 1 4 2026-02-13T20:11:02.198 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T20:11:02.198 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_1 td/divergent-priors/existing 2026-02-13T20:11:02.228 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T20:11:02.228 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_2 td/divergent-priors/existing 2026-02-13T20:11:02.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T20:11:02.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_3 td/divergent-priors/existing 2026-02-13T20:11:02.284 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T20:11:02.284 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_4 td/divergent-priors/existing 2026-02-13T20:11:02.312 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:210: TEST_divergent: rm -f td/divergent-priors/existing 2026-02-13T20:11:02.314 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:212: TEST_divergent: find td/divergent-priors -name '*osd*log' 2026-02-13T20:11:02.315 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:212: TEST_divergent: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-13T20:11:02.320 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:10:39.504+0000 7f418bc2d640 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 26'101 (26'100) modify 1:c156033e:::existing_100:head by client.4534.0:1 2026-02-13T20:09:46.701709+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-13T20:11:02.320 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:10:39.504+0000 7f418bc2d640 20 _merge_object_divergent_entries: keeping 26'101 (26'100) modify 1:c156033e:::existing_100:head by client.4534.0:1 2026-02-13T20:09:46.701709+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-13T20:11:02.321 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:10:39.504+0000 7f418bc2d640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T20:11:02.321 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:10:39.504+0000 7f418bc2d640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 26'100 first_divergent_update: 26'101 last_divergent_update: 26'101 2026-02-13T20:11:02.321 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:10:39.504+0000 7f418bc2d640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2026-02-13T20:11:02.321 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:10:39.504+0000 7f418bc2d640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2026-02-13T20:11:02.321 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:10:39.504+0000 7f418bc2d640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 26'101 2026-02-13T20:11:02.321 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:10:39.504+0000 7f418bc2d640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 26'101 (26'100) modify 1:c156033e:::existing_100:head by client.4534.0:1 2026-02-13T20:09:46.701709+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-13T20:11:02.321 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:10:39.504+0000 7f418bc2d640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2026-02-13T20:11:02.321 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: find td/divergent-priors -name '*osd*log' 2026-02-13T20:11:02.322 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: grep -q '_merge_object_divergent_entries.*cannot roll back, removing and adding to missing' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-13T20:11:02.325 INFO:tasks.workunit.client.0.trial030.stdout:success 2026-02-13T20:11:02.325 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:219: TEST_divergent: echo success 2026-02-13T20:11:02.325 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:221: TEST_divergent: rm -f /tmp/tmp.T5mBZmXxdw 2026-02-13T20:11:02.326 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:222: TEST_divergent: delete_pool test 2026-02-13T20:11:02.326 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-13T20:11:02.326 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-13T20:11:02.585 INFO:tasks.workunit.client.0.trial030.stderr:pool 'test' does not exist 2026-02-13T20:11:02.595 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:223: TEST_divergent: kill_daemons td/divergent-priors 2026-02-13T20:11:02.596 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:11:02.596 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:11:02.596 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:11:02.596 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:11:02.596 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:11:07.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:11:07.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-13T20:11:07.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-13T20:11:07.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T20:11:07.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-13T20:11:07.913 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:11:07.913 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:11:07.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:11:07.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:11:07.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:11:07.920 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:11:07.920 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T20:11:07.921 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T20:11:07.921 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T20:11:07.922 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T20:11:07.923 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T20:11:07.923 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T20:11:07.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:11:07.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T20:11:07.925 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T20:11:07.925 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:11:07.926 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:11:07.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T20:11:07.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-13T20:11:07.947 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T20:11:07.947 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:11:07.947 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:11:07.947 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19555 2026-02-13T20:11:07.948 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T20:11:07.948 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T20:11:07.948 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-13T20:11:07.948 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-13T20:11:07.948 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-13T20:11:07.948 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-13T20:11:07.948 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-13T20:11:07.948 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T20:11:07.948 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-13T20:11:07.949 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:11:07.949 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:11:07.949 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:11:07.949 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:11:07.949 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:11:07.951 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:11:07.951 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T20:11:07.952 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T20:11:07.953 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T20:11:07.954 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T20:11:07.954 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T20:11:07.954 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T20:11:07.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:11:07.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T20:11:07.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T20:11:07.956 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:11:07.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:11:07.958 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T20:11:07.958 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-13T20:11:07.959 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T20:11:07.959 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:11:07.960 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:11:07.960 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19555 2026-02-13T20:11:07.961 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T20:11:07.961 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T20:11:07.961 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-13T20:11:07.962 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T20:11:07.962 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:11:07.962 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:11:07.963 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.19555 2026-02-13T20:11:07.964 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T20:11:07.965 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T20:11:07.965 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T20:11:07.965 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-13T20:11:07.965 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_2 td/divergent-priors 2026-02-13T20:11:07.965 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:422: TEST_divergent_2: local dir=td/divergent-priors 2026-02-13T20:11:07.965 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:424: TEST_divergent_2: file_with_random_data 2026-02-13T20:11:07.965 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-13T20:11:07.966 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-13T20:11:07.967 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:07.967 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.4SiAvSnaJT bs=512 count=1 2026-02-13T20:11:07.967 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records in 2026-02-13T20:11:07.968 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records out 2026-02-13T20:11:07.968 INFO:tasks.workunit.client.0.trial030.stderr:512 bytes copied, 0.000181396 s, 2.8 MB/s 2026-02-13T20:11:07.968 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:07.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:424: TEST_divergent_2: local dummyfile=/tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:07.968 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:426: TEST_divergent_2: file_with_random_data 1000 2026-02-13T20:11:07.968 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=1000 2026-02-13T20:11:07.968 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-13T20:11:07.969 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.J8HCYN4F42 2026-02-13T20:11:07.969 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.J8HCYN4F42 bs=1000 count=1 2026-02-13T20:11:07.970 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records in 2026-02-13T20:11:07.970 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records out 2026-02-13T20:11:07.970 INFO:tasks.workunit.client.0.trial030.stderr:1000 bytes (1.0 kB) copied, 5.9531e-05 s, 16.8 MB/s 2026-02-13T20:11:07.970 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.J8HCYN4F42 2026-02-13T20:11:07.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:426: TEST_divergent_2: local dummyfile2=/tmp/tmp.J8HCYN4F42 2026-02-13T20:11:07.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:428: TEST_divergent_2: local num_osds=3 2026-02-13T20:11:07.971 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: expr 3 - 1 2026-02-13T20:11:07.972 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: seq 0 2 2026-02-13T20:11:07.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: local 'osds=0 2026-02-13T20:11:07.973 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:11:07.973 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:11:07.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:430: TEST_divergent_2: run_mon td/divergent-priors a 2026-02-13T20:11:07.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-13T20:11:07.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T20:11:07.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T20:11:07.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T20:11:07.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-13T20:11:07.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-13T20:11:08.001 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T20:11:08.001 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:11:08.001 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:11:08.001 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:11:08.001 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:11:08.001 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:11:08.001 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:11:08.002 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T20:11:08.034 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T20:11:08.035 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T20:11:08.035 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T20:11:08.035 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T20:11:08.035 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T20:11:08.036 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T20:11:08.036 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T20:11:08.037 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T20:11:08.037 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T20:11:08.037 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:11:08.037 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:11:08.037 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:11:08.037 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-mon.a.asok 2026-02-13T20:11:08.037 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T20:11:08.037 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19555/ceph-mon.a.asok config get fsid 2026-02-13T20:11:08.092 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T20:11:08.092 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T20:11:08.092 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T20:11:08.092 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T20:11:08.092 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T20:11:08.094 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T20:11:08.094 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T20:11:08.094 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T20:11:08.094 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:11:08.094 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:11:08.094 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:11:08.094 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-mon.a.asok 2026-02-13T20:11:08.094 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T20:11:08.094 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19555/ceph-mon.a.asok config get mon_host 2026-02-13T20:11:08.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:431: TEST_divergent_2: run_mgr td/divergent-priors x 2026-02-13T20:11:08.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-13T20:11:08.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T20:11:08.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T20:11:08.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T20:11:08.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-13T20:11:08.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T20:11:08.267 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T20:11:08.268 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:11:08.268 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:11:08.268 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:11:08.268 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:11:08.268 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:11:08.268 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:11:08.269 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T20:11:08.269 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T20:11:08.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-13T20:11:08.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 0 2026-02-13T20:11:08.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T20:11:08.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:11:08.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T20:11:08.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:11:08.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-13T20:11:08.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:11:08.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:11:08.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:11:08.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:11:08.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-13T20:11:08.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-13T20:11:08.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:11:08.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:11:08.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:11:08.290 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:11:08.290 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:11:08.290 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:11:08.291 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:11:08.291 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:11:08.291 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:11:08.291 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:11:08.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:11:08.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:11:08.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:11:08.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:11:08.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:11:08.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:11:08.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:11:08.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:11:08.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:11:08.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:11:08.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:11:08.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:11:08.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-13T20:11:08.292 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:11:08.294 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=21c7ad92-65a7-4d22-99f5-140ea378e021 2026-02-13T20:11:08.294 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 21c7ad92-65a7-4d22-99f5-140ea378e021' 2026-02-13T20:11:08.294 INFO:tasks.workunit.client.0.trial030.stdout:add osd0 21c7ad92-65a7-4d22-99f5-140ea378e021 2026-02-13T20:11:08.294 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:11:08.308 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBchY9pVcQkEhAAmR2dwH+KMsvRvMYjSwhfAA== 2026-02-13T20:11:08.308 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBchY9pVcQkEhAAmR2dwH+KMsvRvMYjSwhfAA=="}' 2026-02-13T20:11:08.308 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 21c7ad92-65a7-4d22-99f5-140ea378e021 -i td/divergent-priors/0/new.json 2026-02-13T20:11:08.423 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:11:08.431 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-13T20:11:08.432 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBchY9pVcQkEhAAmR2dwH+KMsvRvMYjSwhfAA== --osd-uuid 21c7ad92-65a7-4d22-99f5-140ea378e021 2026-02-13T20:11:08.452 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:08.447+0000 7fcee5602a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:08.454 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:08.447+0000 7fcee5602a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:08.455 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:08.447+0000 7fcee5602a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:08.456 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:08.451+0000 7fcee5602a40 -1 bdev(0x56084802a400 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-13T20:11:08.456 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:08.451+0000 7fcee5602a40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-13T20:11:09.239 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-13T20:11:09.239 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:11:09.240 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T20:11:09.240 INFO:tasks.workunit.client.0.trial030.stdout:adding osd0 key to auth repository 2026-02-13T20:11:09.241 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:11:09.362 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-13T20:11:09.363 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T20:11:09.364 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:11:09.364 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:11:09.364 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:11:09.364 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:11:09.393 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:09.387+0000 7f9d709cba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:09.395 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:09.387+0000 7f9d709cba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:09.397 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:09.391+0000 7f9d709cba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:09.473 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T20:11:09.473 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:11:09.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T20:11:09.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:11:09.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:11:09.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:11:09.474 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:11:09.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:11:09.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:11:09.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:11:09.585 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:11:09.953 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:09.947+0000 7f9d709cba40 -1 Falling back to public interface 2026-02-13T20:11:10.587 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:11:10.587 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:11:10.587 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:11:10.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:11:10.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:11:10.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:11:10.795 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:11:10.966 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:10.959+0000 7f9d709cba40 -1 osd.0 0 log_to_monitors true 2026-02-13T20:11:11.797 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:11:11.797 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:11:11.797 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:11:11.798 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T20:11:11.798 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:11:11.798 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:11:12.006 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1591765414,v1:127.0.0.1:6801/1591765414] [v2:127.0.0.1:6802/1591765414,v1:127.0.0.1:6803/1591765414] exists,up 21c7ad92-65a7-4d22-99f5-140ea378e021 2026-02-13T20:11:12.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:11:12.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:11:12.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:11:12.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-13T20:11:12.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 1 2026-02-13T20:11:12.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T20:11:12.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:11:12.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T20:11:12.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:11:12.010 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-13T20:11:12.010 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:11:12.010 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:11:12.010 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:11:12.010 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:11:12.010 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T20:11:12.010 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T20:11:12.010 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:11:12.010 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:11:12.010 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:11:12.010 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:11:12.010 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:11:12.011 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:11:12.011 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:11:12.011 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:11:12.011 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:11:12.011 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:11:12.011 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:11:12.011 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:11:12.011 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:11:12.011 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:11:12.011 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:11:12.011 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:11:12.011 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:11:12.011 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:11:12.012 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:11:12.012 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:11:12.012 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:11:12.012 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:11:12.012 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-13T20:11:12.013 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:11:12.013 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c315988c-ebf1-4438-a258-0f0ea7b0ede6 2026-02-13T20:11:12.013 INFO:tasks.workunit.client.0.trial030.stdout:add osd1 c315988c-ebf1-4438-a258-0f0ea7b0ede6 2026-02-13T20:11:12.014 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 c315988c-ebf1-4438-a258-0f0ea7b0ede6' 2026-02-13T20:11:12.014 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:11:12.025 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBghY9pl5tGARAAx5ZhGB2sN8bLlbHJb8iaiA== 2026-02-13T20:11:12.025 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBghY9pl5tGARAAx5ZhGB2sN8bLlbHJb8iaiA=="}' 2026-02-13T20:11:12.026 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c315988c-ebf1-4438-a258-0f0ea7b0ede6 -i td/divergent-priors/1/new.json 2026-02-13T20:11:12.246 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:11:12.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-13T20:11:12.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBghY9pl5tGARAAx5ZhGB2sN8bLlbHJb8iaiA== --osd-uuid c315988c-ebf1-4438-a258-0f0ea7b0ede6 2026-02-13T20:11:12.275 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:12.271+0000 7f992357ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:12.277 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:12.271+0000 7f992357ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:12.278 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:12.271+0000 7f992357ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:12.278 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:12.271+0000 7f992357ba40 -1 bdev(0x55bb0a7ae400 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-13T20:11:12.279 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:12.271+0000 7f992357ba40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-13T20:11:12.942 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-13T20:11:12.942 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:11:12.943 INFO:tasks.workunit.client.0.trial030.stdout:adding osd1 key to auth repository 2026-02-13T20:11:12.943 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T20:11:12.944 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:11:13.241 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-13T20:11:13.241 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T20:11:13.241 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:11:13.241 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:11:13.241 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:11:13.242 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:11:13.272 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:13.267+0000 7f9528c63a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:13.273 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:13.267+0000 7f9528c63a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:13.275 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:13.267+0000 7f9528c63a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:13.463 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T20:11:13.463 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:11:13.463 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T20:11:13.464 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:11:13.464 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:11:13.464 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:11:13.464 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:11:13.465 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:11:13.465 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:11:13.466 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:11:13.672 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:11:13.725 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:13.720+0000 7f9528c63a40 -1 Falling back to public interface 2026-02-13T20:11:14.316 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:14.312+0000 7f9528c63a40 -1 osd.1 0 log_to_monitors true 2026-02-13T20:11:14.673 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:11:14.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:11:14.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:11:14.674 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:11:14.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:11:14.675 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:11:14.896 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:11:15.897 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:11:15.897 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:11:15.897 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:11:15.897 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T20:11:15.897 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:11:15.898 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:11:16.115 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2536958630,v1:127.0.0.1:6811/2536958630] [v2:127.0.0.1:6812/2536958630,v1:127.0.0.1:6813/2536958630] exists,up c315988c-ebf1-4438-a258-0f0ea7b0ede6 2026-02-13T20:11:16.118 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:11:16.118 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:11:16.118 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:11:16.119 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-13T20:11:16.119 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 2 2026-02-13T20:11:16.119 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T20:11:16.119 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:11:16.119 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T20:11:16.119 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:11:16.119 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-13T20:11:16.119 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:11:16.119 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:11:16.119 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:11:16.119 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:11:16.120 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-13T20:11:16.120 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-13T20:11:16.120 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:11:16.120 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:11:16.120 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:11:16.120 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:11:16.120 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:11:16.120 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:11:16.120 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:11:16.120 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:11:16.120 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:11:16.120 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:11:16.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:11:16.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:11:16.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:11:16.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:11:16.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:11:16.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:11:16.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:11:16.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:11:16.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:11:16.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:11:16.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:11:16.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:11:16.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-13T20:11:16.122 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:11:16.122 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c311b715-6cd8-404f-b1fc-3a6a779abd75 2026-02-13T20:11:16.123 INFO:tasks.workunit.client.0.trial030.stdout:add osd2 c311b715-6cd8-404f-b1fc-3a6a779abd75 2026-02-13T20:11:16.123 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 c311b715-6cd8-404f-b1fc-3a6a779abd75' 2026-02-13T20:11:16.123 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:11:16.135 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBkhY9pflLgBxAAR/9PqsksVos0IfIntAcQHg== 2026-02-13T20:11:16.135 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBkhY9pflLgBxAAR/9PqsksVos0IfIntAcQHg=="}' 2026-02-13T20:11:16.135 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c311b715-6cd8-404f-b1fc-3a6a779abd75 -i td/divergent-priors/2/new.json 2026-02-13T20:11:16.347 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:11:16.357 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-13T20:11:16.358 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBkhY9pflLgBxAAR/9PqsksVos0IfIntAcQHg== --osd-uuid c311b715-6cd8-404f-b1fc-3a6a779abd75 2026-02-13T20:11:16.378 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:16.372+0000 7fb06d174a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:16.379 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:16.376+0000 7fb06d174a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:16.380 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:16.376+0000 7fb06d174a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:16.381 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:16.376+0000 7fb06d174a40 -1 bdev(0x55fc1a774400 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-13T20:11:16.381 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:16.376+0000 7fb06d174a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-13T20:11:17.044 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-13T20:11:17.045 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:11:17.045 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T20:11:17.046 INFO:tasks.workunit.client.0.trial030.stdout:adding osd2 key to auth repository 2026-02-13T20:11:17.046 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:11:17.353 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T20:11:17.354 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-13T20:11:17.354 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:11:17.355 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:11:17.355 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:11:17.355 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:11:17.383 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:17.380+0000 7fcbb250da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:17.385 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:17.380+0000 7fcbb250da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:17.386 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:17.384+0000 7fcbb250da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:17.568 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T20:11:17.568 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:11:17.568 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T20:11:17.568 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:11:17.569 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:11:17.569 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:11:17.569 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:11:17.570 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:11:17.570 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:11:17.571 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:11:17.794 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:11:17.840 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:17.833+0000 7fcbb250da40 -1 Falling back to public interface 2026-02-13T20:11:18.484 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:18.477+0000 7fcbb250da40 -1 osd.2 0 log_to_monitors true 2026-02-13T20:11:18.795 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:11:18.795 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:11:18.795 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:11:18.796 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:11:18.796 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:11:18.796 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:11:19.019 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:11:20.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:11:20.021 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:11:20.021 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:11:20.021 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T20:11:20.022 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:11:20.022 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:11:20.234 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/915400510,v1:127.0.0.1:6819/915400510] [v2:127.0.0.1:6820/915400510,v1:127.0.0.1:6821/915400510] exists,up c311b715-6cd8-404f-b1fc-3a6a779abd75 2026-02-13T20:11:20.234 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:11:20.234 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:11:20.234 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:11:20.234 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:437: TEST_divergent_2: ceph osd set noout 2026-02-13T20:11:20.555 INFO:tasks.workunit.client.0.trial030.stderr:noout is set 2026-02-13T20:11:20.567 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:438: TEST_divergent_2: ceph osd set noin 2026-02-13T20:11:20.859 INFO:tasks.workunit.client.0.trial030.stderr:noin is set 2026-02-13T20:11:20.871 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:439: TEST_divergent_2: ceph osd set nodown 2026-02-13T20:11:21.165 INFO:tasks.workunit.client.0.trial030.stderr:nodown is set 2026-02-13T20:11:21.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:440: TEST_divergent_2: create_pool test 1 1 2026-02-13T20:11:21.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-13T20:11:21.418 INFO:tasks.workunit.client.0.trial030.stderr:pool 'test' already exists 2026-02-13T20:11:21.429 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T20:11:22.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:441: TEST_divergent_2: ceph osd pool set test size 3 2026-02-13T20:11:22.786 INFO:tasks.workunit.client.0.trial030.stderr:set pool 1 size to 3 2026-02-13T20:11:22.798 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:442: TEST_divergent_2: ceph osd pool set test min_size 2 2026-02-13T20:11:23.092 INFO:tasks.workunit.client.0.trial030.stderr:set pool 1 min_size to 2 2026-02-13T20:11:23.102 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:444: TEST_divergent_2: flush_pg_stats 2026-02-13T20:11:23.102 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T20:11:23.102 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T20:11:23.326 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T20:11:23.327 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:11:23.327 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:11:23.327 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T20:11:23.327 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:11:23.327 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-13T20:11:23.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-13T20:11:23.411 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-13T20:11:23.411 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-13T20:11:23.411 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:11:23.411 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-13T20:11:23.495 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672965 2026-02-13T20:11:23.496 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672965 2026-02-13T20:11:23.496 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672965' 2026-02-13T20:11:23.496 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:11:23.496 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-13T20:11:23.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509443 2026-02-13T20:11:23.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509443 2026-02-13T20:11:23.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672965 2-64424509443' 2026-02-13T20:11:23.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:11:23.577 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-13T20:11:23.577 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:11:23.578 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-13T20:11:23.578 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-13T20:11:23.579 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:11:23.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-13T20:11:23.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-13T20:11:23.580 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836485 2026-02-13T20:11:23.581 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:11:23.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836485 2026-02-13T20:11:23.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:11:24.802 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T20:11:24.802 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:11:25.023 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-13T20:11:25.023 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:11:25.024 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672965 2026-02-13T20:11:25.024 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:11:25.024 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-13T20:11:25.025 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672965 2026-02-13T20:11:25.025 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:11:25.027 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672965 2026-02-13T20:11:25.027 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672965' 2026-02-13T20:11:25.027 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 42949672965 2026-02-13T20:11:25.027 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T20:11:25.242 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672965 -lt 42949672965 2026-02-13T20:11:25.242 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:11:25.242 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509443 2026-02-13T20:11:25.243 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:11:25.243 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-13T20:11:25.244 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509443 2026-02-13T20:11:25.244 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:11:25.246 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509443 2026-02-13T20:11:25.246 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 64424509443 2026-02-13T20:11:25.246 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509443' 2026-02-13T20:11:25.247 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:11:25.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509443 -lt 64424509443 2026-02-13T20:11:25.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:445: TEST_divergent_2: wait_for_clean 2026-02-13T20:11:25.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T20:11:25.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T20:11:25.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T20:11:25.477 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T20:11:25.478 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T20:11:25.478 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T20:11:25.479 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T20:11:25.479 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T20:11:25.479 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T20:11:25.575 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T20:11:25.575 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T20:11:25.575 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T20:11:25.575 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T20:11:25.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T20:11:25.576 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T20:11:25.787 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T20:11:25.788 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:11:25.788 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:11:25.788 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T20:11:25.788 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:11:25.788 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-13T20:11:25.873 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-13T20:11:25.873 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-13T20:11:25.873 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-13T20:11:25.873 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:11:25.873 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-13T20:11:25.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672968 2026-02-13T20:11:25.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672968 2026-02-13T20:11:25.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672968' 2026-02-13T20:11:25.956 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:11:25.956 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-13T20:11:26.038 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509446 2026-02-13T20:11:26.038 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509446 2026-02-13T20:11:26.038 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672968 2-64424509446' 2026-02-13T20:11:26.038 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:11:26.039 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-13T20:11:26.039 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:11:26.039 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-13T20:11:26.040 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-13T20:11:26.040 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:11:26.041 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-13T20:11:26.042 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836487 2026-02-13T20:11:26.042 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-13T20:11:26.042 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:11:26.253 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-13T20:11:26.253 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:11:27.254 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T20:11:27.255 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:11:27.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-13T20:11:27.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:11:27.473 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672968 2026-02-13T20:11:27.473 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:11:27.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-13T20:11:27.475 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672968 2026-02-13T20:11:27.475 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:11:27.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672968 2026-02-13T20:11:27.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672968' 2026-02-13T20:11:27.476 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 42949672968 2026-02-13T20:11:27.477 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T20:11:27.689 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672968 -lt 42949672968 2026-02-13T20:11:27.689 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:11:27.690 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509446 2026-02-13T20:11:27.690 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:11:27.691 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-13T20:11:27.692 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509446 2026-02-13T20:11:27.692 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:11:27.693 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509446 2026-02-13T20:11:27.693 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 64424509446 2026-02-13T20:11:27.693 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509446' 2026-02-13T20:11:27.694 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:11:27.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509446 -lt 64424509446 2026-02-13T20:11:27.915 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T20:11:27.915 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:11:27.915 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:11:28.204 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T20:11:28.204 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:11:28.204 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:11:28.204 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:11:28.204 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:11:28.204 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:11:28.204 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:11:28.204 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:11:28.413 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-13T20:11:28.414 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:11:28.414 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:11:28.414 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:11:28.688 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-13T20:11:28.689 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T20:11:28.689 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T20:11:28.690 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: ceph pg dump pgs --format=json 2026-02-13T20:11:28.690 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: jq '.pg_stats[0].up_primary' 2026-02-13T20:11:28.886 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:11:28.896 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: local divergent=1 2026-02-13T20:11:28.896 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:449: TEST_divergent_2: echo 'primary and soon to be divergent is 1' 2026-02-13T20:11:28.896 INFO:tasks.workunit.client.0.trial030.stdout:primary and soon to be divergent is 1 2026-02-13T20:11:28.896 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:450: TEST_divergent_2: ceph pg dump pgs 2026-02-13T20:11:29.099 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:11:29.099 INFO:tasks.workunit.client.0.trial030.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T20:11:22.516811+0000 0'0 28:20 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:11:21.364684+0000 0'0 2026-02-13T20:11:21.364684+0000 0 0 periodic scrub scheduled @ 2026-02-15T00:43:22.011835+0000 0 0 2026-02-13T20:11:29.100 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:11:29.100 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:11:29.100 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:11:29.109 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:451: TEST_divergent_2: local non_divergent= 2026-02-13T20:11:29.109 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-13T20:11:29.109 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 0 = 1 ']' 2026-02-13T20:11:29.109 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:457: TEST_divergent_2: non_divergent=' 0' 2026-02-13T20:11:29.109 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-13T20:11:29.109 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 1 = 1 ']' 2026-02-13T20:11:29.109 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:455: TEST_divergent_2: continue 2026-02-13T20:11:29.109 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-13T20:11:29.110 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 2 = 1 ']' 2026-02-13T20:11:29.110 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:457: TEST_divergent_2: non_divergent=' 0 2' 2026-02-13T20:11:29.110 INFO:tasks.workunit.client.0.trial030.stdout:writing initial objects 2026-02-13T20:11:29.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:460: TEST_divergent_2: echo 'writing initial objects' 2026-02-13T20:11:29.111 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: seq 1 100 2026-02-13T20:11:29.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_1 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.132 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.132 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_2 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.159 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.160 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_3 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.187 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.187 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_4 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_5 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.242 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.242 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_6 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_7 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.293 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.293 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_8 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.320 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.320 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_9 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.346 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.346 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_10 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.374 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.374 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_11 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.401 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.402 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_12 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_13 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.458 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.458 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_14 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.486 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.486 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_15 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.514 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.514 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_16 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.542 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.542 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_17 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.562 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.562 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_18 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_19 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.610 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.610 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_20 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.640 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.640 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_21 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_22 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.682 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.682 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_23 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_24 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_25 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.765 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.765 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_26 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.793 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.793 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_27 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.821 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.822 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_28 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.849 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.849 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_29 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.878 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.878 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_30 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.910 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.910 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_31 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.938 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.939 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_32 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_33 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:29.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:29.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_34 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.025 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.025 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_35 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.047 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.047 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_36 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.074 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.074 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_37 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_38 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.131 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.131 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_39 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.158 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.158 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_40 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.186 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.186 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_41 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.213 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.214 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_42 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.241 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.241 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_43 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.269 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.269 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_44 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.298 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.298 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_45 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.326 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.326 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_46 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.353 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.353 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_47 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_48 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_49 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.438 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.438 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_50 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.467 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.468 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_51 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.497 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.497 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_52 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.526 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.526 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_53 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.546 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.546 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_54 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_55 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.603 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.603 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_56 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_57 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_58 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.688 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.688 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_59 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_60 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.736 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.736 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_61 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.757 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.757 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_62 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_63 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.813 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.813 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_64 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.836 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.836 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_65 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.858 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.858 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_66 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.885 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.886 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_67 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_68 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.941 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.941 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_69 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_70 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:30.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:30.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_71 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.026 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.026 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_72 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.046 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.046 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_73 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.074 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.074 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_74 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.102 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.102 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_75 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.129 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.129 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_76 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.157 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.157 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_77 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.185 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.185 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_78 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.213 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.213 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_79 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.241 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.241 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_80 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.269 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.269 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_81 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.297 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.297 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_82 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.325 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.325 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_83 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.353 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.353 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_84 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_85 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_86 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.437 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.437 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_87 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.466 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.466 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_88 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.496 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.496 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_89 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.524 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.524 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_90 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.553 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.553 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_91 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.581 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_92 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.609 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.609 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_93 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.637 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.637 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_94 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_95 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.693 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.693 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_96 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.722 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.722 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_97 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.749 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.749 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_98 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.778 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_99 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T20:11:31.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_100 /tmp/tmp.4SiAvSnaJT 2026-02-13T20:11:31.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:467: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-13T20:11:31.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:467: TEST_divergent_2: wait_for_clean 2026-02-13T20:11:31.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T20:11:31.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T20:11:31.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T20:11:31.835 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-13T20:11:31.835 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T20:11:31.835 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T20:11:31.836 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T20:11:31.836 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T20:11:31.836 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T20:11:31.906 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-13T20:11:31.906 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T20:11:31.906 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T20:11:31.906 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T20:11:31.906 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T20:11:31.906 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T20:11:32.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T20:11:32.121 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:11:32.122 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:11:32.122 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T20:11:32.122 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:11:32.122 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-13T20:11:32.205 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-13T20:11:32.205 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-13T20:11:32.206 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491' 2026-02-13T20:11:32.206 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:11:32.206 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-13T20:11:32.288 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672971 2026-02-13T20:11:32.288 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672971 2026-02-13T20:11:32.288 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-42949672971' 2026-02-13T20:11:32.288 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:11:32.288 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-13T20:11:32.374 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509449 2026-02-13T20:11:32.374 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509449 2026-02-13T20:11:32.374 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-42949672971 2-64424509449' 2026-02-13T20:11:32.374 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:11:32.375 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836491 2026-02-13T20:11:32.375 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:11:32.376 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-13T20:11:32.376 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-13T20:11:32.376 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:11:32.378 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836491 2026-02-13T20:11:32.378 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-13T20:11:32.378 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836491 2026-02-13T20:11:32.379 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:11:32.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-13T20:11:32.606 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:11:32.606 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672971 2026-02-13T20:11:32.606 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:11:32.607 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-13T20:11:32.608 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672971 2026-02-13T20:11:32.608 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:11:32.609 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672971 2026-02-13T20:11:32.610 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672971' 2026-02-13T20:11:32.610 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 42949672971 2026-02-13T20:11:32.610 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T20:11:32.829 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672971 -lt 42949672971 2026-02-13T20:11:32.829 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:11:32.830 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509449 2026-02-13T20:11:32.830 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:11:32.831 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-13T20:11:32.831 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509449 2026-02-13T20:11:32.832 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:11:32.833 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509449 2026-02-13T20:11:32.833 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509449' 2026-02-13T20:11:32.833 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 64424509449 2026-02-13T20:11:32.834 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:11:33.044 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509449 -lt 64424509449 2026-02-13T20:11:33.045 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T20:11:33.045 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:11:33.045 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:11:33.326 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T20:11:33.326 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:11:33.326 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:11:33.326 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:11:33.326 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:11:33.327 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:11:33.327 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:11:33.327 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:11:33.534 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-13T20:11:33.535 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:11:33.535 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:11:33.535 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:11:33.812 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-13T20:11:33.812 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T20:11:33.812 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T20:11:33.812 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:469: TEST_divergent_2: get_pg test existing_1 2026-02-13T20:11:33.812 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-13T20:11:33.812 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-13T20:11:33.812 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-13T20:11:33.812 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-13T20:11:34.036 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:469: TEST_divergent_2: local pgid=1.0 2026-02-13T20:11:34.037 INFO:tasks.workunit.client.0.trial030.stdout:blackholing osds 0 2 2026-02-13T20:11:34.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:472: TEST_divergent_2: echo 'blackholing osds 0 2' 2026-02-13T20:11:34.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:473: TEST_divergent_2: ceph pg dump pgs 2026-02-13T20:11:34.241 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:11:34.241 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-13T20:11:22.516811+0000 28'100 28:120 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:11:21.364684+0000 0'0 2026-02-13T20:11:21.364684+0000 0 0 periodic scrub scheduled @ 2026-02-15T00:43:22.011835+0000 0 0 2026-02-13T20:11:34.241 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:11:34.241 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:11:34.241 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:11:34.252 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:474: TEST_divergent_2: for i in $non_divergent 2026-02-13T20:11:34.253 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: get_asok_path osd.0 2026-02-13T20:11:34.253 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T20:11:34.253 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T20:11:34.253 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:11:34.253 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:11:34.253 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:11:34.254 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.0.asok 2026-02-13T20:11:34.254 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: CEPH_ARGS= 2026-02-13T20:11:34.254 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-13T20:11:34.308 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-13T20:11:34.308 INFO:tasks.workunit.client.0.trial030.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-13T20:11:34.308 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-13T20:11:34.314 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:474: TEST_divergent_2: for i in $non_divergent 2026-02-13T20:11:34.315 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: get_asok_path osd.2 2026-02-13T20:11:34.315 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-13T20:11:34.315 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-13T20:11:34.315 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:11:34.315 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:11:34.315 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:11:34.316 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.2.asok 2026-02-13T20:11:34.316 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: CEPH_ARGS= 2026-02-13T20:11:34.316 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-13T20:11:34.368 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-13T20:11:34.368 INFO:tasks.workunit.client.0.trial030.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-13T20:11:34.368 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-13T20:11:34.374 INFO:tasks.workunit.client.0.trial030.stdout:create new divergent objects 2026-02-13T20:11:34.374 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:480: TEST_divergent_2: echo 'create new divergent objects' 2026-02-13T20:11:34.374 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: seq 1 2 2026-02-13T20:11:34.375 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-13T20:11:34.375 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-13T20:11:34.376 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:483: TEST_divergent_2: rados -p test create newobject_1 2026-02-13T20:11:34.376 INFO:tasks.workunit.client.0.trial030.stdout:writing divergent objects 2026-02-13T20:11:34.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:486: TEST_divergent_2: echo 'writing divergent objects' 2026-02-13T20:11:34.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:483: TEST_divergent_2: rados -p test create newobject_2 2026-02-13T20:11:34.377 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: seq 1 2 2026-02-13T20:11:34.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-13T20:11:34.378 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-13T20:11:34.378 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:489: TEST_divergent_2: rados -p test put existing_1 /tmp/tmp.J8HCYN4F42 2026-02-13T20:11:34.378 INFO:tasks.workunit.client.0.trial030.stdout:remove divergent objects 2026-02-13T20:11:34.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:492: TEST_divergent_2: echo 'remove divergent objects' 2026-02-13T20:11:34.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:489: TEST_divergent_2: rados -p test put existing_2 /tmp/tmp.J8HCYN4F42 2026-02-13T20:11:34.379 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: seq 1 2 2026-02-13T20:11:34.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-13T20:11:34.380 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: expr 1 + 2 2026-02-13T20:11:34.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rmi=3 2026-02-13T20:11:34.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-13T20:11:34.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:496: TEST_divergent_2: rados -p test rm existing_3 2026-02-13T20:11:34.381 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: expr 2 + 2 2026-02-13T20:11:34.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rmi=4 2026-02-13T20:11:34.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:498: TEST_divergent_2: sleep 10 2026-02-13T20:11:34.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:496: TEST_divergent_2: rados -p test rm existing_4 2026-02-13T20:11:44.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:499: TEST_divergent_2: killall -9 rados 2026-02-13T20:11:44.422 INFO:tasks.workunit.client.0.trial030.stderr:rados: no process found 2026-02-13T20:11:44.423 INFO:tasks.workunit.client.0.trial030.stdout:killing all the osds 2026-02-13T20:11:44.423 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:502: TEST_divergent_2: echo 'killing all the osds' 2026-02-13T20:11:44.423 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:503: TEST_divergent_2: ceph pg dump pgs 2026-02-13T20:11:44.623 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:11:44.624 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 active+clean 2026-02-13T20:11:22.516811+0000 28'106 28:126 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:11:21.364684+0000 0'0 2026-02-13T20:11:21.364684+0000 0 0 periodic scrub scheduled @ 2026-02-15T00:43:22.011835+0000 0 0 2026-02-13T20:11:44.624 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:11:44.624 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:11:44.624 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:11:44.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:504: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd 2026-02-13T20:11:44.633 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:11:44.633 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:11:44.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:11:44.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:11:44.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:11:44.742 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:11:44.742 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-13T20:11:44.742 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.0 2026-02-13T20:11:45.012 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already down. 2026-02-13T20:11:45.022 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-13T20:11:45.022 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.1 2026-02-13T20:11:45.296 INFO:tasks.workunit.client.0.trial030.stderr:osd.1 is already down. 2026-02-13T20:11:45.307 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-13T20:11:45.308 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.2 2026-02-13T20:11:45.580 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already down. 2026-02-13T20:11:45.590 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:509: TEST_divergent_2: for i in $non_divergent 2026-02-13T20:11:45.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:511: TEST_divergent_2: ceph osd out osd.0 2026-02-13T20:11:45.866 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already out. 2026-02-13T20:11:45.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:509: TEST_divergent_2: for i in $non_divergent 2026-02-13T20:11:45.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:511: TEST_divergent_2: ceph osd out osd.2 2026-02-13T20:11:46.151 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already out. 2026-02-13T20:11:46.161 INFO:tasks.workunit.client.0.trial030.stdout:bringing up non_divergent 0 2 2026-02-13T20:11:46.162 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:515: TEST_divergent_2: echo 'bringing up non_divergent 0 2' 2026-02-13T20:11:46.162 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:516: TEST_divergent_2: ceph pg dump pgs 2026-02-13T20:11:46.381 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:11:46.382 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 stale+active+clean 2026-02-13T20:11:22.516811+0000 28'106 28:126 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:11:21.364684+0000 0'0 2026-02-13T20:11:21.364684+0000 0 0 periodic scrub scheduled @ 2026-02-15T00:43:22.011835+0000 0 0 2026-02-13T20:11:46.382 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:11:46.382 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:11:46.383 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:11:46.391 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:517: TEST_divergent_2: for i in $non_divergent 2026-02-13T20:11:46.391 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:519: TEST_divergent_2: activate_osd td/divergent-priors 0 2026-02-13T20:11:46.391 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T20:11:46.392 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T20:11:46.392 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-13T20:11:46.392 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T20:11:46.392 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-13T20:11:46.392 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:11:46.392 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:11:46.392 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:11:46.392 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:11:46.392 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-13T20:11:46.392 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-13T20:11:46.392 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T20:11:46.393 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T20:11:46.393 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:11:46.393 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T20:11:46.393 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:11:46.393 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:11:46.393 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:11:46.393 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:11:46.393 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:11:46.393 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:11:46.393 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:11:46.393 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:11:46.394 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:11:46.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:11:46.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:11:46.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:11:46.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:11:46.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:11:46.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T20:11:46.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T20:11:46.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-13T20:11:46.396 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-13T20:11:46.396 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-13T20:11:46.397 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:11:46.397 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-13T20:11:46.397 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-13T20:11:46.397 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T20:11:46.397 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T20:11:46.397 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T20:11:46.416 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:46.416+0000 7f0d31240a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:46.417 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:46.416+0000 7f0d31240a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:46.418 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:46.420+0000 7f0d31240a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:46.617 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-13T20:11:46.617 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:11:46.617 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T20:11:46.617 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:11:46.617 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:11:46.617 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:11:46.617 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:11:46.617 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:11:46.617 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:11:46.617 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:11:46.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:11:46.871 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:46.872+0000 7f0d31240a40 -1 Falling back to public interface 2026-02-13T20:11:47.483 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:47.480+0000 7f0d31240a40 -1 osd.0 28 log_to_monitors true 2026-02-13T20:11:47.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:11:47.842 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:11:47.842 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:11:47.842 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:11:47.842 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:11:47.842 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:11:48.058 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up out weight 0 up_from 35 up_thru 0 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/2542521444,v1:127.0.0.1:6801/2542521444] [v2:127.0.0.1:6802/2542521444,v1:127.0.0.1:6803/2542521444] exists,up 21c7ad92-65a7-4d22-99f5-140ea378e021 2026-02-13T20:11:48.062 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:11:48.062 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:11:48.062 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:11:48.062 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:517: TEST_divergent_2: for i in $non_divergent 2026-02-13T20:11:48.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:519: TEST_divergent_2: activate_osd td/divergent-priors 2 2026-02-13T20:11:48.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T20:11:48.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T20:11:48.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T20:11:48.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T20:11:48.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-13T20:11:48.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:11:48.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:11:48.064 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:11:48.064 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:11:48.064 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-13T20:11:48.064 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-13T20:11:48.064 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T20:11:48.064 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T20:11:48.064 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:11:48.064 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T20:11:48.065 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:11:48.065 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:11:48.065 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:11:48.065 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:11:48.065 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:11:48.065 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:11:48.065 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:11:48.065 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:11:48.066 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:11:48.066 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:11:48.066 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:11:48.066 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:11:48.066 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:11:48.066 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:11:48.067 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T20:11:48.067 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T20:11:48.067 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-13T20:11:48.067 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-13T20:11:48.069 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T20:11:48.069 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:11:48.069 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-13T20:11:48.069 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T20:11:48.069 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T20:11:48.069 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T20:11:48.069 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T20:11:48.081 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:48.077+0000 7f3716740a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:48.082 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:48.081+0000 7f3716740a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:48.083 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:48.081+0000 7f3716740a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:11:48.286 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T20:11:48.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:11:48.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T20:11:48.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:11:48.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:11:48.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:11:48.287 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:11:48.288 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:11:48.288 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:11:48.288 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:11:48.471 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:48.469+0000 7f3716740a40 -1 Falling back to public interface 2026-02-13T20:11:48.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:11:49.134 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:11:49.133+0000 7f3716740a40 -1 osd.2 28 log_to_monitors true 2026-02-13T20:11:49.500 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:11:49.500 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:11:49.500 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:11:49.500 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:11:49.501 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:11:49.501 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:11:49.715 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up out weight 0 up_from 37 up_thru 0 down_at 31 last_clean_interval [15,28) [v2:127.0.0.1:6810/42962094,v1:127.0.0.1:6811/42962094] [v2:127.0.0.1:6812/42962094,v1:127.0.0.1:6813/42962094] exists,up c311b715-6cd8-404f-b1fc-3a6a779abd75 2026-02-13T20:11:49.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:11:49.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:11:49.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:11:49.716 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:521: TEST_divergent_2: for i in $non_divergent 2026-02-13T20:11:49.716 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:523: TEST_divergent_2: ceph osd in osd.0 2026-02-13T20:11:49.961 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already in. 2026-02-13T20:11:49.971 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:521: TEST_divergent_2: for i in $non_divergent 2026-02-13T20:11:49.971 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:523: TEST_divergent_2: ceph osd in osd.2 2026-02-13T20:11:50.266 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already in. 2026-02-13T20:11:50.276 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:526: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-13T20:11:50.276 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:526: TEST_divergent_2: wait_for_clean 2026-02-13T20:11:50.276 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T20:11:50.276 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T20:11:50.276 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T20:11:50.276 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-13T20:11:50.276 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T20:11:50.276 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T20:11:50.277 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T20:11:50.277 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T20:11:50.277 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T20:11:50.347 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-13T20:11:50.347 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T20:11:50.347 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T20:11:50.347 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T20:11:50.347 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T20:11:50.348 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T20:11:50.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T20:11:50.564 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:11:50.564 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:11:50.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T20:11:50.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:11:50.564 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-13T20:11:50.647 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855363 2026-02-13T20:11:50.647 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855363 2026-02-13T20:11:50.647 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363' 2026-02-13T20:11:50.647 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:11:50.647 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-13T20:11:50.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-13T20:11:50.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-13T20:11:50.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-13T20:11:50.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-13T20:11:50.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:11:50.711 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-13T20:11:50.794 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789955 2026-02-13T20:11:50.795 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789955 2026-02-13T20:11:50.795 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363 2-158913789955' 2026-02-13T20:11:50.795 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:11:50.795 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855363 2026-02-13T20:11:50.795 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:11:50.796 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-13T20:11:50.797 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855363 2026-02-13T20:11:50.797 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:11:50.798 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855363 2026-02-13T20:11:50.798 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 150323855363 2026-02-13T20:11:50.799 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855363' 2026-02-13T20:11:50.799 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:11:51.012 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 150323855363 2026-02-13T20:11:51.012 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:11:52.014 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T20:11:52.014 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:11:52.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 150323855363 2026-02-13T20:11:52.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:11:53.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-13T20:11:53.230 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:11:53.450 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855363 -lt 150323855363 2026-02-13T20:11:53.450 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:11:53.451 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-158913789955 2026-02-13T20:11:53.451 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:11:53.452 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-13T20:11:53.453 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-158913789955 2026-02-13T20:11:53.453 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:11:53.454 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789955 2026-02-13T20:11:53.454 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 158913789955 2026-02-13T20:11:53.455 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 158913789955' 2026-02-13T20:11:53.455 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:11:53.678 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789955 -lt 158913789955 2026-02-13T20:11:53.679 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T20:11:53.679 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:11:53.679 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:11:53.967 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T20:11:53.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:11:53.968 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:11:53.968 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:11:53.968 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:11:53.968 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:11:53.968 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:11:53.968 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:11:54.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:11:54.181 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:11:54.181 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:11:54.181 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:11:54.460 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:11:54.460 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-13T20:11:54.460 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-13T20:11:54.460 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-13T20:11:54.461 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:11:54.461 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-13T20:11:54.561 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:11:54.561 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:11:54.562 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:11:54.562 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:11:54.562 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:11:54.562 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:11:54.562 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:11:54.562 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:11:54.766 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:11:54.766 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:11:54.766 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:11:54.766 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:11:55.057 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:11:55.057 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:11:55.057 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:11:55.057 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:11:55.057 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:11:55.057 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:11:55.057 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:11:55.058 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:11:55.058 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:11:55.340 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:11:55.340 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:11:55.341 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-13T20:11:55.341 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:11:55.341 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-13T20:11:55.541 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:11:55.542 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:11:55.543 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:11:55.543 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:11:55.543 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:11:55.543 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:11:55.543 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:11:55.543 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:11:55.752 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:11:55.752 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:11:55.753 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:11:55.753 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:11:56.032 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:11:56.032 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:11:56.032 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:11:56.032 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:11:56.032 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:11:56.032 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:11:56.032 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:11:56.032 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:11:56.032 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:11:56.316 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:11:56.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:11:56.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-13T20:11:56.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:11:56.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-13T20:11:56.717 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:11:56.717 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:11:56.717 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:11:56.717 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:11:56.717 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:11:56.718 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:11:56.718 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:11:56.718 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:11:56.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:11:56.927 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:11:56.928 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:11:56.928 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:11:57.212 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:11:57.212 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:11:57.212 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:11:57.212 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:11:57.212 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:11:57.212 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:11:57.212 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:11:57.212 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:11:57.212 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:11:57.495 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:11:57.495 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:11:57.495 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-13T20:11:57.495 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:11:57.496 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-13T20:11:58.296 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:11:58.296 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:11:58.297 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:11:58.297 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:11:58.297 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:11:58.297 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:11:58.297 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:11:58.298 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:11:58.508 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:11:58.508 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:11:58.509 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:11:58.509 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:11:58.793 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:11:58.793 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:11:58.793 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:11:58.794 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:11:58.794 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:11:58.794 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:11:58.794 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:11:58.794 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:11:58.794 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:11:59.081 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:11:59.081 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:11:59.082 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-13T20:11:59.082 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:11:59.082 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-13T20:12:00.683 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:12:00.683 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:12:00.683 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:12:00.683 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:12:00.683 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:12:00.683 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:12:00.684 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:12:00.684 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:12:00.898 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:12:00.899 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:12:00.899 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:12:00.899 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:12:01.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:12:01.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:12:01.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:12:01.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:12:01.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:12:01.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:12:01.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:12:01.195 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:12:01.195 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:12:01.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:12:01.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:12:01.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-13T20:12:01.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:12:01.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-13T20:12:04.693 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:12:04.693 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:12:04.694 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:12:04.694 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:12:04.694 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:12:04.695 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:12:04.695 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:12:04.695 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:12:04.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:12:04.915 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:12:04.915 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:12:04.915 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:12:05.206 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:12:05.206 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:12:05.206 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:12:05.207 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:12:05.207 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:12:05.207 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:12:05.207 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:12:05.207 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:12:05.207 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:12:05.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:12:05.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:12:05.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-13T20:12:05.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:12:05.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-13T20:12:11.900 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:12:11.900 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:12:11.901 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:12:11.901 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:12:11.901 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:12:11.901 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:12:11.902 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:12:11.902 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:12:12.120 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:12:12.120 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:12:12.121 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:12:12.121 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:12:12.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:12:12.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:12:12.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:12:12.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:12:12.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:12:12.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:12:12.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:12:12.410 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:12:12.410 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:12:12.696 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:12:12.696 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:12:12.696 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-13T20:12:12.696 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:12:12.696 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-13T20:12:19.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:12:19.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:12:19.998 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:12:19.998 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:12:19.999 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:12:19.999 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:12:19.999 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:12:19.999 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:12:20.213 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:12:20.213 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:12:20.213 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:12:20.214 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:12:20.507 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:12:20.507 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:12:20.507 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:12:20.508 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:12:20.508 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:12:20.508 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:12:20.508 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:12:20.508 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:12:20.508 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:12:20.797 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:12:20.797 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:12:20.797 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-13T20:12:20.797 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-13T20:12:21.082 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-13T20:12:21.082 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_fingerprint": "a2930821-eeb4-436a-a84f-154754ab32fa", 2026-02-13T20:12:21.082 INFO:tasks.workunit.client.0.trial030.stdout: "version": "20.3.0-5230-gafefaa40", 2026-02-13T20:12:21.082 INFO:tasks.workunit.client.0.trial030.stdout: "commit": "afefaa40503a4bf024e96f97dd7f852b75f00ad6", 2026-02-13T20:12:21.082 INFO:tasks.workunit.client.0.trial030.stdout: "timestamp": "2026-02-13T20:12:21.086225+0000", 2026-02-13T20:12:21.082 INFO:tasks.workunit.client.0.trial030.stdout: "tag": "", 2026-02-13T20:12:21.082 INFO:tasks.workunit.client.0.trial030.stdout: "health": { 2026-02-13T20:12:21.083 INFO:tasks.workunit.client.0.trial030.stdout: "status": "HEALTH_WARN", 2026-02-13T20:12:21.083 INFO:tasks.workunit.client.0.trial030.stdout: "checks": { 2026-02-13T20:12:21.083 INFO:tasks.workunit.client.0.trial030.stdout: "OSDMAP_FLAGS": { 2026-02-13T20:12:21.083 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-13T20:12:21.083 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-13T20:12:21.083 INFO:tasks.workunit.client.0.trial030.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-13T20:12:21.083 INFO:tasks.workunit.client.0.trial030.stdout: "count": 17 2026-02-13T20:12:21.083 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.083 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [], 2026-02-13T20:12:21.083 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-13T20:12:21.083 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.083 INFO:tasks.workunit.client.0.trial030.stdout: "OSD_DOWN": { 2026-02-13T20:12:21.084 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-13T20:12:21.084 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-13T20:12:21.084 INFO:tasks.workunit.client.0.trial030.stdout: "message": "1 osds down", 2026-02-13T20:12:21.084 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-13T20:12:21.084 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.084 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-13T20:12:21.084 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.084 INFO:tasks.workunit.client.0.trial030.stdout: "message": "osd.1 (root=default,host=trial030) is down" 2026-02-13T20:12:21.084 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.084 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:21.084 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-13T20:12:21.084 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.085 INFO:tasks.workunit.client.0.trial030.stdout: "PG_DEGRADED": { 2026-02-13T20:12:21.085 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-13T20:12:21.085 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-13T20:12:21.085 INFO:tasks.workunit.client.0.trial030.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-13T20:12:21.085 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-13T20:12:21.085 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.085 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-13T20:12:21.085 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.085 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:12:21.085 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.085 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:21.086 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-13T20:12:21.086 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.086 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.086 INFO:tasks.workunit.client.0.trial030.stdout: "mutes": [] 2026-02-13T20:12:21.086 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.086 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_first_committed": 1, 2026-02-13T20:12:21.086 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_last_committed": 1, 2026-02-13T20:12:21.086 INFO:tasks.workunit.client.0.trial030.stdout: "monmap": { 2026-02-13T20:12:21.086 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-13T20:12:21.086 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "76a1de22-3326-43d1-82f4-48cedec81b31", 2026-02-13T20:12:21.086 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-13T20:11:07.990776Z", 2026-02-13T20:12:21.086 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-13T20:11:07.990776Z", 2026-02-13T20:12:21.086 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release": 20, 2026-02-13T20:12:21.087 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:12:21.087 INFO:tasks.workunit.client.0.trial030.stdout: "election_strategy": 1, 2026-02-13T20:12:21.087 INFO:tasks.workunit.client.0.trial030.stdout: "disallowed_leaders": "", 2026-02-13T20:12:21.087 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": false, 2026-02-13T20:12:21.087 INFO:tasks.workunit.client.0.trial030.stdout: "tiebreaker_mon": "", 2026-02-13T20:12:21.087 INFO:tasks.workunit.client.0.trial030.stdout: "removed_ranks": "", 2026-02-13T20:12:21.087 INFO:tasks.workunit.client.0.trial030.stdout: "features": { 2026-02-13T20:12:21.087 INFO:tasks.workunit.client.0.trial030.stdout: "persistent": [ 2026-02-13T20:12:21.087 INFO:tasks.workunit.client.0.trial030.stdout: "kraken", 2026-02-13T20:12:21.087 INFO:tasks.workunit.client.0.trial030.stdout: "luminous", 2026-02-13T20:12:21.087 INFO:tasks.workunit.client.0.trial030.stdout: "mimic", 2026-02-13T20:12:21.087 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap-prune", 2026-02-13T20:12:21.088 INFO:tasks.workunit.client.0.trial030.stdout: "nautilus", 2026-02-13T20:12:21.088 INFO:tasks.workunit.client.0.trial030.stdout: "octopus", 2026-02-13T20:12:21.088 INFO:tasks.workunit.client.0.trial030.stdout: "pacific", 2026-02-13T20:12:21.088 INFO:tasks.workunit.client.0.trial030.stdout: "elector-pinging", 2026-02-13T20:12:21.088 INFO:tasks.workunit.client.0.trial030.stdout: "quincy", 2026-02-13T20:12:21.088 INFO:tasks.workunit.client.0.trial030.stdout: "reef", 2026-02-13T20:12:21.088 INFO:tasks.workunit.client.0.trial030.stdout: "squid", 2026-02-13T20:12:21.088 INFO:tasks.workunit.client.0.trial030.stdout: "tentacle", 2026-02-13T20:12:21.088 INFO:tasks.workunit.client.0.trial030.stdout: "nvmeof_beacon_diff" 2026-02-13T20:12:21.088 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:21.088 INFO:tasks.workunit.client.0.trial030.stdout: "optional": [] 2026-02-13T20:12:21.088 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.088 INFO:tasks.workunit.client.0.trial030.stdout: "mons": [ 2026-02-13T20:12:21.089 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.089 INFO:tasks.workunit.client.0.trial030.stdout: "rank": 0, 2026-02-13T20:12:21.089 INFO:tasks.workunit.client.0.trial030.stdout: "name": "a", 2026-02-13T20:12:21.089 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:12:21.089 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:21.089 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.089 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:21.089 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115", 2026-02-13T20:12:21.089 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 0 2026-02-13T20:12:21.089 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.089 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.089 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.090 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115/0", 2026-02-13T20:12:21.090 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-13T20:12:21.090 INFO:tasks.workunit.client.0.trial030.stdout: "priority": 0, 2026-02-13T20:12:21.090 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 0, 2026-02-13T20:12:21.090 INFO:tasks.workunit.client.0.trial030.stdout: "time_added": "2026-02-13T20:11:07:990774+0000", 2026-02-13T20:12:21.090 INFO:tasks.workunit.client.0.trial030.stdout: "crush_location": [] 2026-02-13T20:12:21.090 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.090 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.090 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.090 INFO:tasks.workunit.client.0.trial030.stdout: "quorum": [ 2026-02-13T20:12:21.090 INFO:tasks.workunit.client.0.trial030.stdout: 0 2026-02-13T20:12:21.090 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:21.090 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap": { 2026-02-13T20:12:21.091 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 41, 2026-02-13T20:12:21.091 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "76a1de22-3326-43d1-82f4-48cedec81b31", 2026-02-13T20:12:21.091 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-13T20:11:08.074235+0000", 2026-02-13T20:12:21.091 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-13T20:11:50.313749+0000", 2026-02-13T20:12:21.091 INFO:tasks.workunit.client.0.trial030.stdout: "last_up_change": "2026-02-13T20:11:49.292085+0000", 2026-02-13T20:12:21.091 INFO:tasks.workunit.client.0.trial030.stdout: "last_in_change": "2026-02-13T20:11:50.211777+0000", 2026-02-13T20:12:21.091 INFO:tasks.workunit.client.0.trial030.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-13T20:12:21.091 INFO:tasks.workunit.client.0.trial030.stdout: "flags_num": 5800384, 2026-02-13T20:12:21.091 INFO:tasks.workunit.client.0.trial030.stdout: "flags_set": [ 2026-02-13T20:12:21.091 INFO:tasks.workunit.client.0.trial030.stdout: "nodown", 2026-02-13T20:12:21.091 INFO:tasks.workunit.client.0.trial030.stdout: "noin", 2026-02-13T20:12:21.091 INFO:tasks.workunit.client.0.trial030.stdout: "noout", 2026-02-13T20:12:21.091 INFO:tasks.workunit.client.0.trial030.stdout: "pglog_hardlimit", 2026-02-13T20:12:21.092 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snapdirs", 2026-02-13T20:12:21.092 INFO:tasks.workunit.client.0.trial030.stdout: "recovery_deletes", 2026-02-13T20:12:21.092 INFO:tasks.workunit.client.0.trial030.stdout: "sortbitwise" 2026-02-13T20:12:21.092 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:21.092 INFO:tasks.workunit.client.0.trial030.stdout: "crush_version": 9, 2026-02-13T20:12:21.092 INFO:tasks.workunit.client.0.trial030.stdout: "full_ratio": 0.99000000953674316, 2026-02-13T20:12:21.092 INFO:tasks.workunit.client.0.trial030.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-13T20:12:21.092 INFO:tasks.workunit.client.0.trial030.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-13T20:12:21.092 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_snapshot": "", 2026-02-13T20:12:21.092 INFO:tasks.workunit.client.0.trial030.stdout: "pool_max": 1, 2026-02-13T20:12:21.092 INFO:tasks.workunit.client.0.trial030.stdout: "max_osd": 3, 2026-02-13T20:12:21.092 INFO:tasks.workunit.client.0.trial030.stdout: "require_min_compat_client": "luminous", 2026-02-13T20:12:21.093 INFO:tasks.workunit.client.0.trial030.stdout: "min_compat_client": "jewel", 2026-02-13T20:12:21.093 INFO:tasks.workunit.client.0.trial030.stdout: "require_osd_release": "tentacle", 2026-02-13T20:12:21.093 INFO:tasks.workunit.client.0.trial030.stdout: "allow_crimson": false, 2026-02-13T20:12:21.093 INFO:tasks.workunit.client.0.trial030.stdout: "pools": [ 2026-02-13T20:12:21.093 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.093 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-13T20:12:21.093 INFO:tasks.workunit.client.0.trial030.stdout: "pool_name": "test", 2026-02-13T20:12:21.093 INFO:tasks.workunit.client.0.trial030.stdout: "create_time": "2026-02-13T20:11:21.340228+0000", 2026-02-13T20:12:21.093 INFO:tasks.workunit.client.0.trial030.stdout: "flags": 1, 2026-02-13T20:12:21.093 INFO:tasks.workunit.client.0.trial030.stdout: "flags_names": "hashpspool", 2026-02-13T20:12:21.093 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-13T20:12:21.093 INFO:tasks.workunit.client.0.trial030.stdout: "size": 3, 2026-02-13T20:12:21.094 INFO:tasks.workunit.client.0.trial030.stdout: "min_size": 2, 2026-02-13T20:12:21.094 INFO:tasks.workunit.client.0.trial030.stdout: "crush_rule": 0, 2026-02-13T20:12:21.094 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_count": 0, 2026-02-13T20:12:21.094 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_target": 0, 2026-02-13T20:12:21.094 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_barrier": 0, 2026-02-13T20:12:21.094 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-13T20:12:21.094 INFO:tasks.workunit.client.0.trial030.stdout: "is_stretch_pool": false, 2026-02-13T20:12:21.094 INFO:tasks.workunit.client.0.trial030.stdout: "object_hash": 2, 2026-02-13T20:12:21.094 INFO:tasks.workunit.client.0.trial030.stdout: "pg_autoscale_mode": "off", 2026-02-13T20:12:21.094 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num": 1, 2026-02-13T20:12:21.094 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num": 1, 2026-02-13T20:12:21.094 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num_target": 1, 2026-02-13T20:12:21.094 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_target": 1, 2026-02-13T20:12:21.095 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_pending": 1, 2026-02-13T20:12:21.095 INFO:tasks.workunit.client.0.trial030.stdout: "last_pg_merge_meta": { 2026-02-13T20:12:21.095 INFO:tasks.workunit.client.0.trial030.stdout: "source_pgid": "0.0", 2026-02-13T20:12:21.095 INFO:tasks.workunit.client.0.trial030.stdout: "ready_epoch": 0, 2026-02-13T20:12:21.095 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_started": 0, 2026-02-13T20:12:21.095 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": 0, 2026-02-13T20:12:21.095 INFO:tasks.workunit.client.0.trial030.stdout: "source_version": "0'0", 2026-02-13T20:12:21.095 INFO:tasks.workunit.client.0.trial030.stdout: "target_version": "0'0" 2026-02-13T20:12:21.095 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.095 INFO:tasks.workunit.client.0.trial030.stdout: "last_change": "28", 2026-02-13T20:12:21.095 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend": "0", 2026-02-13T20:12:21.095 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-13T20:12:21.095 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_preluminous": "0", 2026-02-13T20:12:21.095 INFO:tasks.workunit.client.0.trial030.stdout: "auid": 0, 2026-02-13T20:12:21.096 INFO:tasks.workunit.client.0.trial030.stdout: "snap_mode": "selfmanaged", 2026-02-13T20:12:21.096 INFO:tasks.workunit.client.0.trial030.stdout: "snap_seq": 0, 2026-02-13T20:12:21.096 INFO:tasks.workunit.client.0.trial030.stdout: "snap_epoch": 0, 2026-02-13T20:12:21.096 INFO:tasks.workunit.client.0.trial030.stdout: "pool_snaps": [], 2026-02-13T20:12:21.096 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps": "[]", 2026-02-13T20:12:21.096 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_bytes": 0, 2026-02-13T20:12:21.096 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_objects": 0, 2026-02-13T20:12:21.096 INFO:tasks.workunit.client.0.trial030.stdout: "tiers": [], 2026-02-13T20:12:21.096 INFO:tasks.workunit.client.0.trial030.stdout: "tier_of": -1, 2026-02-13T20:12:21.096 INFO:tasks.workunit.client.0.trial030.stdout: "read_tier": -1, 2026-02-13T20:12:21.096 INFO:tasks.workunit.client.0.trial030.stdout: "write_tier": -1, 2026-02-13T20:12:21.096 INFO:tasks.workunit.client.0.trial030.stdout: "cache_mode": "none", 2026-02-13T20:12:21.096 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_bytes": 0, 2026-02-13T20:12:21.097 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_objects": 0, 2026-02-13T20:12:21.097 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-13T20:12:21.097 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-13T20:12:21.097 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-13T20:12:21.097 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_flush_age": 0, 2026-02-13T20:12:21.097 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_evict_age": 0, 2026-02-13T20:12:21.097 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profile": "", 2026-02-13T20:12:21.097 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_params": { 2026-02-13T20:12:21.097 INFO:tasks.workunit.client.0.trial030.stdout: "type": "none" 2026-02-13T20:12:21.097 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.097 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_period": 0, 2026-02-13T20:12:21.097 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_count": 0, 2026-02-13T20:12:21.097 INFO:tasks.workunit.client.0.trial030.stdout: "use_gmt_hitset": true, 2026-02-13T20:12:21.098 INFO:tasks.workunit.client.0.trial030.stdout: "min_read_recency_for_promote": 0, 2026-02-13T20:12:21.098 INFO:tasks.workunit.client.0.trial030.stdout: "min_write_recency_for_promote": 0, 2026-02-13T20:12:21.098 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_grade_decay_rate": 0, 2026-02-13T20:12:21.098 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_search_last_n": 0, 2026-02-13T20:12:21.098 INFO:tasks.workunit.client.0.trial030.stdout: "grade_table": [], 2026-02-13T20:12:21.098 INFO:tasks.workunit.client.0.trial030.stdout: "stripe_width": 0, 2026-02-13T20:12:21.098 INFO:tasks.workunit.client.0.trial030.stdout: "expected_num_objects": 0, 2026-02-13T20:12:21.098 INFO:tasks.workunit.client.0.trial030.stdout: "fast_read": false, 2026-02-13T20:12:21.098 INFO:tasks.workunit.client.0.trial030.stdout: "nonprimary_shards": "{}", 2026-02-13T20:12:21.098 INFO:tasks.workunit.client.0.trial030.stdout: "options": {}, 2026-02-13T20:12:21.098 INFO:tasks.workunit.client.0.trial030.stdout: "application_metadata": {}, 2026-02-13T20:12:21.098 INFO:tasks.workunit.client.0.trial030.stdout: "read_balance": { 2026-02-13T20:12:21.098 INFO:tasks.workunit.client.0.trial030.stdout: "score_type": "Fair distribution", 2026-02-13T20:12:21.099 INFO:tasks.workunit.client.0.trial030.stdout: "score_acting": 2.9900000095367432, 2026-02-13T20:12:21.099 INFO:tasks.workunit.client.0.trial030.stdout: "score_stable": 2.9900000095367432, 2026-02-13T20:12:21.099 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_score": 0.67000001668930054, 2026-02-13T20:12:21.099 INFO:tasks.workunit.client.0.trial030.stdout: "raw_score_acting": 2, 2026-02-13T20:12:21.099 INFO:tasks.workunit.client.0.trial030.stdout: "raw_score_stable": 2, 2026-02-13T20:12:21.099 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity_weighted": 1, 2026-02-13T20:12:21.099 INFO:tasks.workunit.client.0.trial030.stdout: "average_primary_affinity": 1, 2026-02-13T20:12:21.099 INFO:tasks.workunit.client.0.trial030.stdout: "average_primary_affinity_weighted": 1 2026-02-13T20:12:21.099 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.099 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.099 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:21.099 INFO:tasks.workunit.client.0.trial030.stdout: "osds": [ 2026-02-13T20:12:21.099 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.100 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:12:21.100 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "21c7ad92-65a7-4d22-99f5-140ea378e021", 2026-02-13T20:12:21.100 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-13T20:12:21.100 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-13T20:12:21.100 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-13T20:12:21.100 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-13T20:12:21.100 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 5, 2026-02-13T20:12:21.100 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 28, 2026-02-13T20:12:21.100 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 35, 2026-02-13T20:12:21.100 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 40, 2026-02-13T20:12:21.100 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 29, 2026-02-13T20:12:21.100 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-13T20:12:21.100 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:12:21.101 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:21.101 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.101 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:21.101 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6800", 2026-02-13T20:12:21.101 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2542521444 2026-02-13T20:12:21.101 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.101 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.101 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:21.101 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6801", 2026-02-13T20:12:21.101 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2542521444 2026-02-13T20:12:21.101 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.102 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.102 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.102 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-13T20:12:21.102 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:21.102 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.102 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:21.102 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6802", 2026-02-13T20:12:21.102 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2542521444 2026-02-13T20:12:21.102 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.102 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.102 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:21.103 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6803", 2026-02-13T20:12:21.103 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2542521444 2026-02-13T20:12:21.103 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.103 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.103 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.103 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-13T20:12:21.103 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:21.103 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.103 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:21.103 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6806", 2026-02-13T20:12:21.104 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2542521444 2026-02-13T20:12:21.104 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.104 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.104 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:21.104 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6807", 2026-02-13T20:12:21.104 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2542521444 2026-02-13T20:12:21.104 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.104 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.104 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.104 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-13T20:12:21.104 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:21.105 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.105 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:21.105 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6804", 2026-02-13T20:12:21.105 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2542521444 2026-02-13T20:12:21.105 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.105 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.105 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:21.105 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6805", 2026-02-13T20:12:21.105 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2542521444 2026-02-13T20:12:21.105 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.105 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.105 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.106 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6801/2542521444", 2026-02-13T20:12:21.106 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6803/2542521444", 2026-02-13T20:12:21.106 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6807/2542521444", 2026-02-13T20:12:21.106 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6805/2542521444", 2026-02-13T20:12:21.106 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-13T20:12:21.106 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-13T20:12:21.106 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-13T20:12:21.106 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.106 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.106 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.106 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:12:21.106 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "c315988c-ebf1-4438-a258-0f0ea7b0ede6", 2026-02-13T20:12:21.107 INFO:tasks.workunit.client.0.trial030.stdout: "up": 0, 2026-02-13T20:12:21.107 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-13T20:12:21.107 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-13T20:12:21.107 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-13T20:12:21.107 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 0, 2026-02-13T20:12:21.107 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 0, 2026-02-13T20:12:21.107 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 10, 2026-02-13T20:12:21.107 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 22, 2026-02-13T20:12:21.107 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 30, 2026-02-13T20:12:21.107 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-13T20:12:21.107 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:12:21.107 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:21.107 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.108 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:21.108 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-13T20:12:21.108 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2536958630 2026-02-13T20:12:21.108 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.108 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.108 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:21.108 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-13T20:12:21.108 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2536958630 2026-02-13T20:12:21.108 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.108 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.109 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.109 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-13T20:12:21.109 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:21.109 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.109 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:21.109 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-13T20:12:21.109 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2536958630 2026-02-13T20:12:21.109 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.109 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.109 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:21.109 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-13T20:12:21.109 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2536958630 2026-02-13T20:12:21.109 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.110 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.110 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.110 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-13T20:12:21.110 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:21.110 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.110 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:21.110 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-13T20:12:21.110 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2536958630 2026-02-13T20:12:21.110 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.110 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.110 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:21.110 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-13T20:12:21.111 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2536958630 2026-02-13T20:12:21.111 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.111 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.111 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.111 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-13T20:12:21.111 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:21.111 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.111 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:21.111 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-13T20:12:21.111 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2536958630 2026-02-13T20:12:21.111 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.111 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.111 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:21.112 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-13T20:12:21.112 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2536958630 2026-02-13T20:12:21.112 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.112 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.112 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.112 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/2536958630", 2026-02-13T20:12:21.112 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/2536958630", 2026-02-13T20:12:21.112 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2536958630", 2026-02-13T20:12:21.112 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2536958630", 2026-02-13T20:12:21.112 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-13T20:12:21.112 INFO:tasks.workunit.client.0.trial030.stdout: "exists" 2026-02-13T20:12:21.112 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.112 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.113 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.113 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:12:21.113 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "c311b715-6cd8-404f-b1fc-3a6a779abd75", 2026-02-13T20:12:21.113 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-13T20:12:21.113 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-13T20:12:21.113 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-13T20:12:21.113 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-13T20:12:21.113 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 15, 2026-02-13T20:12:21.113 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 28, 2026-02-13T20:12:21.113 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 37, 2026-02-13T20:12:21.113 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 0, 2026-02-13T20:12:21.113 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 31, 2026-02-13T20:12:21.114 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-13T20:12:21.114 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:12:21.114 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:21.114 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.114 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:21.114 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-13T20:12:21.114 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 42962094 2026-02-13T20:12:21.114 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.114 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.114 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:21.114 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-13T20:12:21.114 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 42962094 2026-02-13T20:12:21.114 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.115 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.115 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.115 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-13T20:12:21.115 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:21.115 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.115 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:21.115 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-13T20:12:21.115 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 42962094 2026-02-13T20:12:21.115 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.115 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.115 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:21.115 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-13T20:12:21.115 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 42962094 2026-02-13T20:12:21.116 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.116 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.116 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.116 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-13T20:12:21.116 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:21.116 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.116 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:21.116 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-13T20:12:21.116 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 42962094 2026-02-13T20:12:21.116 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.116 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.116 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:21.116 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-13T20:12:21.117 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 42962094 2026-02-13T20:12:21.117 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.117 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.117 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.117 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-13T20:12:21.117 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:21.117 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.117 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:21.117 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-13T20:12:21.117 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 42962094 2026-02-13T20:12:21.117 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.117 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.117 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:21.117 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-13T20:12:21.118 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 42962094 2026-02-13T20:12:21.118 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.118 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.118 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.118 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/42962094", 2026-02-13T20:12:21.118 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/42962094", 2026-02-13T20:12:21.118 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/42962094", 2026-02-13T20:12:21.118 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/42962094", 2026-02-13T20:12:21.118 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-13T20:12:21.118 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-13T20:12:21.118 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-13T20:12:21.118 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.118 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.118 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:21.119 INFO:tasks.workunit.client.0.trial030.stdout: "osd_xinfo": [ 2026-02-13T20:12:21.119 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.119 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:12:21.119 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-13T20:11:44.957817+0000", 2026-02-13T20:12:21.119 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-13T20:12:21.119 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-13T20:12:21.119 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-13T20:12:21.119 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-13T20:12:21.119 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-13T20:11:11.949628+0000", 2026-02-13T20:12:21.119 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-13T20:12:21.119 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.119 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.119 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:12:21.120 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-13T20:11:45.243599+0000", 2026-02-13T20:12:21.120 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-13T20:12:21.120 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-13T20:12:21.120 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-13T20:12:21.120 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-13T20:12:21.120 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-13T20:11:15.343692+0000", 2026-02-13T20:12:21.120 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-13T20:12:21.120 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.120 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.120 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:12:21.120 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-13T20:11:45.524313+0000", 2026-02-13T20:12:21.120 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-13T20:12:21.120 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-13T20:12:21.120 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-13T20:12:21.120 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-13T20:12:21.121 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-13T20:11:19.507288+0000", 2026-02-13T20:12:21.121 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-13T20:12:21.121 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.121 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:21.121 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap": [], 2026-02-13T20:12:21.121 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_items": [], 2026-02-13T20:12:21.121 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_primaries": [], 2026-02-13T20:12:21.121 INFO:tasks.workunit.client.0.trial030.stdout: "pg_temp": [], 2026-02-13T20:12:21.121 INFO:tasks.workunit.client.0.trial030.stdout: "primary_temp": [], 2026-02-13T20:12:21.121 INFO:tasks.workunit.client.0.trial030.stdout: "blocklist": {}, 2026-02-13T20:12:21.121 INFO:tasks.workunit.client.0.trial030.stdout: "range_blocklist": {}, 2026-02-13T20:12:21.121 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profiles": { 2026-02-13T20:12:21.121 INFO:tasks.workunit.client.0.trial030.stdout: "default": { 2026-02-13T20:12:21.121 INFO:tasks.workunit.client.0.trial030.stdout: "k": "2", 2026-02-13T20:12:21.121 INFO:tasks.workunit.client.0.trial030.stdout: "m": "2", 2026-02-13T20:12:21.122 INFO:tasks.workunit.client.0.trial030.stdout: "plugin": "isa", 2026-02-13T20:12:21.122 INFO:tasks.workunit.client.0.trial030.stdout: "technique": "reed_sol_van" 2026-02-13T20:12:21.122 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.122 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.122 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps_queue": [], 2026-02-13T20:12:21.122 INFO:tasks.workunit.client.0.trial030.stdout: "new_removed_snaps": [], 2026-02-13T20:12:21.122 INFO:tasks.workunit.client.0.trial030.stdout: "new_purged_snaps": [], 2026-02-13T20:12:21.122 INFO:tasks.workunit.client.0.trial030.stdout: "crush_node_flags": {}, 2026-02-13T20:12:21.122 INFO:tasks.workunit.client.0.trial030.stdout: "device_class_flags": {}, 2026-02-13T20:12:21.122 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": { 2026-02-13T20:12:21.122 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_enabled": false, 2026-02-13T20:12:21.122 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_bucket_count": 0, 2026-02-13T20:12:21.122 INFO:tasks.workunit.client.0.trial030.stdout: "degraded_stretch_mode": 0, 2026-02-13T20:12:21.122 INFO:tasks.workunit.client.0.trial030.stdout: "recovering_stretch_mode": 0, 2026-02-13T20:12:21.122 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_bucket": 0 2026-02-13T20:12:21.122 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.122 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.123 INFO:tasks.workunit.client.0.trial030.stdout: "osd_metadata": [ 2026-02-13T20:12:21.123 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.123 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:12:21.123 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-13T20:12:21.123 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6802/2542521444,v1:127.0.0.1:6803/2542521444]", 2026-02-13T20:12:21.123 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-13T20:12:21.123 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-13T20:12:21.123 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-13T20:12:21.123 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T20:12:21.123 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-13T20:12:21.123 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T20:12:21.123 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-13T20:12:21.123 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T20:12:21.123 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T20:12:21.123 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T20:12:21.123 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T20:12:21.124 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T20:12:21.124 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-13T20:12:21.124 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T20:12:21.124 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T20:12:21.124 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T20:12:21.124 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T20:12:21.124 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T20:12:21.124 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T20:12:21.124 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-13T20:12:21.124 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-13T20:12:21.124 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:12:21.124 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-13T20:12:21.124 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:12:21.124 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T20:12:21.124 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-13T20:11:09.068498Z", 2026-02-13T20:12:21.124 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-13T20:12:21.124 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-13T20:12:21.125 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T20:12:21.125 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-13T20:12:21.125 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-13T20:12:21.125 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T20:12:21.125 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-13T20:12:21.125 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6800/2542521444,v1:127.0.0.1:6801/2542521444]", 2026-02-13T20:12:21.125 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-13T20:12:21.125 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/2542521444,v1:127.0.0.1:6807/2542521444]", 2026-02-13T20:12:21.125 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/2542521444,v1:127.0.0.1:6805/2542521444]", 2026-02-13T20:12:21.125 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-13T20:12:21.125 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-13T20:12:21.125 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T20:12:21.125 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T20:12:21.125 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-13T20:12:21.125 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961704", 2026-02-13T20:12:21.125 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T20:12:21.125 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-13T20:12:21.125 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-13T20:12:21.126 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-13T20:12:21.126 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/0", 2026-02-13T20:12:21.126 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-13T20:12:21.126 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-13T20:12:21.126 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-13T20:12:21.126 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.126 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.126 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:12:21.126 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-13T20:12:21.126 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/2536958630,v1:127.0.0.1:6813/2536958630]", 2026-02-13T20:12:21.126 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-13T20:12:21.126 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-13T20:12:21.126 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-13T20:12:21.126 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T20:12:21.126 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-13T20:12:21.126 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T20:12:21.126 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-13T20:12:21.127 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T20:12:21.127 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T20:12:21.127 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T20:12:21.127 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T20:12:21.127 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T20:12:21.127 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-13T20:12:21.127 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T20:12:21.127 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T20:12:21.127 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T20:12:21.127 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T20:12:21.127 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T20:12:21.127 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T20:12:21.127 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-13T20:12:21.127 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-13T20:12:21.127 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:12:21.127 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-13T20:12:21.127 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:12:21.127 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T20:12:21.127 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-13T20:11:12.840236Z", 2026-02-13T20:12:21.127 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-13T20:12:21.128 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-13T20:12:21.128 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T20:12:21.128 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-13T20:12:21.128 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-13T20:12:21.128 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T20:12:21.128 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-13T20:12:21.128 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/2536958630,v1:127.0.0.1:6811/2536958630]", 2026-02-13T20:12:21.128 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-13T20:12:21.128 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2536958630,v1:127.0.0.1:6817/2536958630]", 2026-02-13T20:12:21.128 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2536958630,v1:127.0.0.1:6815/2536958630]", 2026-02-13T20:12:21.128 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-13T20:12:21.128 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-13T20:12:21.128 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T20:12:21.128 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T20:12:21.128 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-13T20:12:21.128 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961704", 2026-02-13T20:12:21.128 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T20:12:21.128 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-13T20:12:21.128 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-13T20:12:21.129 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-13T20:12:21.129 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/1", 2026-02-13T20:12:21.129 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-13T20:12:21.129 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-13T20:12:21.129 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-13T20:12:21.129 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.129 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.129 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:12:21.129 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-13T20:12:21.129 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/42962094,v1:127.0.0.1:6813/42962094]", 2026-02-13T20:12:21.129 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-13T20:12:21.129 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-13T20:12:21.129 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-13T20:12:21.129 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T20:12:21.129 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-13T20:12:21.129 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T20:12:21.129 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-13T20:12:21.129 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T20:12:21.129 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T20:12:21.129 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T20:12:21.130 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T20:12:21.130 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T20:12:21.130 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-13T20:12:21.130 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T20:12:21.130 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T20:12:21.130 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T20:12:21.130 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T20:12:21.130 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T20:12:21.130 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T20:12:21.130 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-13T20:12:21.130 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-13T20:12:21.130 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:12:21.130 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-13T20:12:21.130 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:12:21.130 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T20:12:21.130 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-13T20:11:16.940788Z", 2026-02-13T20:12:21.130 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-13T20:12:21.130 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-13T20:12:21.130 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T20:12:21.131 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-13T20:12:21.131 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-13T20:12:21.131 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T20:12:21.131 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-13T20:12:21.131 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/42962094,v1:127.0.0.1:6811/42962094]", 2026-02-13T20:12:21.131 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-13T20:12:21.131 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/42962094,v1:127.0.0.1:6817/42962094]", 2026-02-13T20:12:21.131 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/42962094,v1:127.0.0.1:6815/42962094]", 2026-02-13T20:12:21.131 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-13T20:12:21.131 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-13T20:12:21.131 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T20:12:21.131 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T20:12:21.131 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-13T20:12:21.131 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961704", 2026-02-13T20:12:21.131 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T20:12:21.131 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-13T20:12:21.131 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-13T20:12:21.131 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-13T20:12:21.131 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/2", 2026-02-13T20:12:21.132 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-13T20:12:21.132 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-13T20:12:21.132 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-13T20:12:21.132 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.132 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:21.132 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_clean_epochs": { 2026-02-13T20:12:21.132 INFO:tasks.workunit.client.0.trial030.stdout: "min_last_epoch_clean": 0, 2026-02-13T20:12:21.132 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": { 2026-02-13T20:12:21.132 INFO:tasks.workunit.client.0.trial030.stdout: "per_pool": [] 2026-02-13T20:12:21.132 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.132 INFO:tasks.workunit.client.0.trial030.stdout: "osd_epochs": [ 2026-02-13T20:12:21.132 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.132 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:12:21.132 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 35 2026-02-13T20:12:21.132 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.132 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.132 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:12:21.132 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 38 2026-02-13T20:12:21.132 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.133 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.133 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.133 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_first_committed": 1, 2026-02-13T20:12:21.133 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_last_committed": 41, 2026-02-13T20:12:21.133 INFO:tasks.workunit.client.0.trial030.stdout: "crushmap": { 2026-02-13T20:12:21.133 INFO:tasks.workunit.client.0.trial030.stdout: "devices": [ 2026-02-13T20:12:21.133 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.133 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:12:21.133 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.0", 2026-02-13T20:12:21.133 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-13T20:12:21.133 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.133 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.133 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:12:21.133 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.1", 2026-02-13T20:12:21.133 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-13T20:12:21.133 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.133 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.133 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:12:21.133 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.2", 2026-02-13T20:12:21.133 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-13T20:12:21.133 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.134 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:21.134 INFO:tasks.workunit.client.0.trial030.stdout: "types": [ 2026-02-13T20:12:21.134 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.134 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 0, 2026-02-13T20:12:21.134 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd" 2026-02-13T20:12:21.134 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.134 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.134 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-13T20:12:21.134 INFO:tasks.workunit.client.0.trial030.stdout: "name": "host" 2026-02-13T20:12:21.134 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.134 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.134 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 2, 2026-02-13T20:12:21.134 INFO:tasks.workunit.client.0.trial030.stdout: "name": "chassis" 2026-02-13T20:12:21.134 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.134 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.134 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 3, 2026-02-13T20:12:21.134 INFO:tasks.workunit.client.0.trial030.stdout: "name": "rack" 2026-02-13T20:12:21.134 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.134 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.134 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 4, 2026-02-13T20:12:21.134 INFO:tasks.workunit.client.0.trial030.stdout: "name": "row" 2026-02-13T20:12:21.135 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.135 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.135 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 5, 2026-02-13T20:12:21.135 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pdu" 2026-02-13T20:12:21.135 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.135 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.135 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 6, 2026-02-13T20:12:21.135 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pod" 2026-02-13T20:12:21.135 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.135 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.135 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 7, 2026-02-13T20:12:21.135 INFO:tasks.workunit.client.0.trial030.stdout: "name": "room" 2026-02-13T20:12:21.135 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.135 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.135 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 8, 2026-02-13T20:12:21.135 INFO:tasks.workunit.client.0.trial030.stdout: "name": "datacenter" 2026-02-13T20:12:21.135 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.135 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.135 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 9, 2026-02-13T20:12:21.135 INFO:tasks.workunit.client.0.trial030.stdout: "name": "zone" 2026-02-13T20:12:21.135 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.135 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 10, 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: "name": "region" 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: "name": "root" 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: "buckets": [ 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: "id": -1, 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default", 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:12:21.136 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: "id": -2, 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default~ssd", 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030", 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-13T20:12:21.137 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.138 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030~ssd", 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.139 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: "rules": [ 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: "rule_id": 0, 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: "rule_name": "replicated_rule", 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: "steps": [ 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: "op": "take", 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: "item": -1, 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: "item_name": "default" 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: "op": "choose_firstn", 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: "num": 0, 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: "type": "osd" 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: "op": "emit" 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: "tunables": { 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_tries": 0, 2026-02-13T20:12:21.140 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_fallback_tries": 0, 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: "choose_total_tries": 50, 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_descend_once": 1, 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_vary_r": 1, 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_stable": 1, 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: "msr_descents": 100, 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: "msr_collision_tries": 100, 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: "straw_calc_version": 1, 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: "allowed_bucket_algs": 54, 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: "profile": "jewel", 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_tunables": 1, 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: "legacy_tunables": 0, 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: "minimum_required_version": "jewel", 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables": 1, 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables2": 1, 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: "has_v2_rules": 0, 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables3": 1, 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: "has_v3_rules": 0, 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: "has_v4_buckets": 1, 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables5": 1, 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: "has_v5_rules": 0, 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: "has_msr_rules": 0 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: "choose_args": {} 2026-02-13T20:12:21.141 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.142 INFO:tasks.workunit.client.0.trial030.stderr:report 1461971674 2026-02-13T20:12:21.142 INFO:tasks.workunit.client.0.trial030.stdout: "fsmap": { 2026-02-13T20:12:21.142 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-13T20:12:21.142 INFO:tasks.workunit.client.0.trial030.stdout: "btime": "2026-02-13T20:11:08:074007+0000", 2026-02-13T20:12:21.142 INFO:tasks.workunit.client.0.trial030.stdout: "default_fscid": -1, 2026-02-13T20:12:21.142 INFO:tasks.workunit.client.0.trial030.stdout: "compat": { 2026-02-13T20:12:21.142 INFO:tasks.workunit.client.0.trial030.stdout: "compat": {}, 2026-02-13T20:12:21.142 INFO:tasks.workunit.client.0.trial030.stdout: "ro_compat": {}, 2026-02-13T20:12:21.142 INFO:tasks.workunit.client.0.trial030.stdout: "incompat": { 2026-02-13T20:12:21.142 INFO:tasks.workunit.client.0.trial030.stdout: "feature_1": "base v0.20", 2026-02-13T20:12:21.142 INFO:tasks.workunit.client.0.trial030.stdout: "feature_2": "client writeable ranges", 2026-02-13T20:12:21.142 INFO:tasks.workunit.client.0.trial030.stdout: "feature_3": "default file layouts on dirs", 2026-02-13T20:12:21.142 INFO:tasks.workunit.client.0.trial030.stdout: "feature_4": "dir inode in separate object", 2026-02-13T20:12:21.142 INFO:tasks.workunit.client.0.trial030.stdout: "feature_5": "mds uses versioned encoding", 2026-02-13T20:12:21.142 INFO:tasks.workunit.client.0.trial030.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: "feature_8": "no anchor table", 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: "feature_9": "file layout v2", 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: "feature_10": "snaprealm v2", 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: "feature_11": "minor log segments", 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: "feature_12": "quiesce subvolumes" 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: "feature_flags": { 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: "enable_multiple": true, 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: "ever_enabled_multiple": true 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: "standbys": [], 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: "filesystems": [] 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_first_committed": 1, 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_last_committed": 1, 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: "auth": { 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 5, 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: "num_secrets": 3 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 1, 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_active": 1, 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_unknown": 0, 2026-02-13T20:12:21.143 INFO:tasks.workunit.client.0.trial030.stdout: "num_osd": 3, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "pool_sum": { 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 51200, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 100, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 0, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 300, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 100, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 100, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 100, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 100, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T20:12:21.144 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-13T20:12:21.145 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 16, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 16, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "up": 2, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 2, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 0 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum": { 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 3, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83880, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2096, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 19, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81708, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488920, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036654080, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2146304, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 426240, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:12:21.146 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 19546, 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83669926 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum_by_class": { 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "ssd": { 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 3, 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T20:12:21.147 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83880, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2096, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 19, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81708, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488920, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036654080, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2146304, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 426240, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 19546, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83669926 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-13T20:12:21.148 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "pool_stats": [ 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": 1, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 1, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 51200, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 100, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 0, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 300, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 100, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 100, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 100, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 100, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-13T20:12:21.149 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 1220608, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 153552, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:12:21.150 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 16, 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 16, 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: "up": 2, 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 2, 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 3 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: "osd_stats": [ 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 150323855369 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 42949672973 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 158913789961 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_state": [ 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: "state": "active+undersized+degraded", 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: "num": 1 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:21.151 INFO:tasks.workunit.client.0.trial030.stdout: "pool_pg_unavailable_map": [ 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": "1", 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: "pgs": [] 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_osd": [ 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 1, 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 0, 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": [ 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": {} 2026-02-13T20:12:21.152 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "servicemap": { 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 3, 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-13T20:12:16.540335+0000", 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "services": { 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "osd": { 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "daemons": { 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "summary": "", 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "0": { 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "start_epoch": 0, 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "start_stamp": "0.000000", 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "gid": 0, 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "metadata": {}, 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "task_status": {} 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "2": { 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "start_epoch": 0, 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "start_stamp": "0.000000", 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "gid": 0, 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "metadata": {}, 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "task_status": {} 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_first_committed": 1, 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_last_committed": 37, 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "logm_first_committed": 1, 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "logm_last_committed": 216, 2026-02-13T20:12:21.153 INFO:tasks.workunit.client.0.trial030.stdout: "paxos": { 2026-02-13T20:12:21.154 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-13T20:12:21.154 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 304, 2026-02-13T20:12:21.154 INFO:tasks.workunit.client.0.trial030.stdout: "last_pn": 0, 2026-02-13T20:12:21.154 INFO:tasks.workunit.client.0.trial030.stdout: "accepted_pn": 0 2026-02-13T20:12:21.154 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:21.154 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-13T20:12:21.154 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-13T20:12:21.154 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:529: TEST_divergent_2: expr 2 + 2 2026-02-13T20:12:21.154 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:529: TEST_divergent_2: objname=existing_4 2026-02-13T20:12:21.154 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:530: TEST_divergent_2: echo 'writing non-divergent object existing_4' 2026-02-13T20:12:21.154 INFO:tasks.workunit.client.0.trial030.stdout:writing non-divergent object existing_4 2026-02-13T20:12:21.154 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:531: TEST_divergent_2: ceph pg dump pgs 2026-02-13T20:12:21.298 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:12:21.298 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:11:50.316156+0000 28'100 41:129 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:11:21.364684+0000 0'0 2026-02-13T20:11:21.364684+0000 0 0 periodic scrub scheduled @ 2026-02-14T21:20:00.608467+0000 0 0 2026-02-13T20:12:21.298 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:12:21.298 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:12:21.298 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:12:21.309 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:532: TEST_divergent_2: rados -p test put existing_4 /tmp/tmp.J8HCYN4F42 2026-02-13T20:12:21.332 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:533: TEST_divergent_2: rm -f /tmp/tmp.J8HCYN4F42 2026-02-13T20:12:21.333 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:535: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-13T20:12:21.333 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:535: TEST_divergent_2: wait_for_clean 2026-02-13T20:12:21.333 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T20:12:21.333 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T20:12:21.333 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T20:12:21.333 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-13T20:12:21.334 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T20:12:21.334 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T20:12:21.334 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T20:12:21.334 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T20:12:21.334 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T20:12:21.406 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-13T20:12:21.407 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T20:12:21.407 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T20:12:21.407 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T20:12:21.407 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T20:12:21.407 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T20:12:21.624 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T20:12:21.624 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:12:21.624 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:12:21.624 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T20:12:21.625 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:12:21.625 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-13T20:12:21.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855371 2026-02-13T20:12:21.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855371 2026-02-13T20:12:21.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855371' 2026-02-13T20:12:21.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:12:21.715 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-13T20:12:21.775 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-13T20:12:21.775 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-13T20:12:21.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-13T20:12:21.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-13T20:12:21.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:12:21.776 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-13T20:12:21.855 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789963 2026-02-13T20:12:21.855 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789963 2026-02-13T20:12:21.855 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855371 2-158913789963' 2026-02-13T20:12:21.855 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:12:21.856 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855371 2026-02-13T20:12:21.856 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:12:21.856 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-13T20:12:21.857 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855371 2026-02-13T20:12:21.857 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:12:21.859 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855371 2026-02-13T20:12:21.859 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 150323855371 2026-02-13T20:12:21.859 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855371' 2026-02-13T20:12:21.859 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:12:22.080 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855369 -lt 150323855371 2026-02-13T20:12:22.080 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:12:23.082 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T20:12:23.082 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:12:23.307 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855371 -lt 150323855371 2026-02-13T20:12:23.308 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:12:23.308 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-158913789963 2026-02-13T20:12:23.308 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:12:23.309 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-13T20:12:23.310 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-158913789963 2026-02-13T20:12:23.310 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:12:23.311 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789963 2026-02-13T20:12:23.312 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 158913789963 2026-02-13T20:12:23.312 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 158913789963' 2026-02-13T20:12:23.312 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:12:23.541 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789963 -lt 158913789963 2026-02-13T20:12:23.541 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T20:12:23.542 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:12:23.542 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:12:23.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T20:12:23.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:12:23.839 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:12:23.839 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:12:23.840 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:12:23.840 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:12:23.840 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:12:23.840 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:12:24.052 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:12:24.053 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:12:24.053 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:12:24.053 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:12:24.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:12:24.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-13T20:12:24.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-13T20:12:24.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-13T20:12:24.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:12:24.346 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-13T20:12:24.446 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:12:24.446 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:12:24.447 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:12:24.447 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:12:24.447 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:12:24.447 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:12:24.447 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:12:24.447 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:12:24.662 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:12:24.663 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:12:24.663 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:12:24.663 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:12:24.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:12:24.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:12:24.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:12:24.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:12:24.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:12:24.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:12:24.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:12:24.957 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:12:24.958 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:12:25.246 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:12:25.246 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:12:25.246 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-13T20:12:25.246 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:12:25.246 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-13T20:12:25.446 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:12:25.446 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:12:25.447 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:12:25.447 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:12:25.447 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:12:25.447 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:12:25.447 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:12:25.447 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:12:25.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:12:25.661 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:12:25.661 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:12:25.661 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:12:25.943 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:12:25.943 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:12:25.943 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:12:25.943 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:12:25.944 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:12:25.944 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:12:25.944 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:12:25.944 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:12:25.944 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:12:26.231 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:12:26.232 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:12:26.232 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-13T20:12:26.232 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:12:26.232 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-13T20:12:26.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:12:26.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:12:26.633 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:12:26.633 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:12:26.633 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:12:26.633 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:12:26.634 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:12:26.634 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:12:26.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:12:26.840 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:12:26.840 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:12:26.840 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:12:27.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:12:27.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:12:27.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:12:27.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:12:27.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:12:27.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:12:27.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:12:27.121 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:12:27.121 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:12:27.402 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:12:27.402 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:12:27.402 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-13T20:12:27.402 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:12:27.402 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-13T20:12:28.204 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:12:28.204 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:12:28.205 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:12:28.205 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:12:28.205 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:12:28.205 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:12:28.205 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:12:28.205 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:12:28.416 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:12:28.417 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:12:28.417 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:12:28.418 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:12:28.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:12:28.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:12:28.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:12:28.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:12:28.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:12:28.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:12:28.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:12:28.709 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:12:28.709 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:12:29.002 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:12:29.002 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:12:29.002 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-13T20:12:29.002 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:12:29.003 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-13T20:12:30.603 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:12:30.604 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:12:30.605 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:12:30.605 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:12:30.605 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:12:30.605 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:12:30.605 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:12:30.605 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:12:30.817 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:12:30.818 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:12:30.818 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:12:30.818 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:12:31.100 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:12:31.101 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:12:31.101 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:12:31.101 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:12:31.101 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:12:31.101 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:12:31.101 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:12:31.101 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:12:31.101 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:12:31.374 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:12:31.374 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:12:31.374 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-13T20:12:31.374 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:12:31.374 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-13T20:12:34.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:12:34.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:12:34.576 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:12:34.576 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:12:34.576 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:12:34.576 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:12:34.577 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:12:34.577 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:12:34.793 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:12:34.794 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:12:34.794 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:12:34.794 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:12:35.089 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:12:35.090 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:12:35.090 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:12:35.090 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:12:35.090 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:12:35.090 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:12:35.090 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:12:35.090 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:12:35.090 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:12:35.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:12:35.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:12:35.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-13T20:12:35.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:12:35.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-13T20:12:41.783 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:12:41.783 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:12:41.783 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:12:41.783 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:12:41.783 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:12:41.783 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:12:41.784 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:12:41.784 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:12:42.006 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:12:42.007 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:12:42.007 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:12:42.007 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:12:42.308 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:12:42.308 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:12:42.308 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:12:42.309 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:12:42.309 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:12:42.309 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:12:42.309 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:12:42.309 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:12:42.309 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:12:42.598 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:12:42.599 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:12:42.599 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-13T20:12:42.599 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:12:42.599 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-13T20:12:49.900 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:12:49.900 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:12:49.901 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:12:49.901 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:12:49.901 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:12:49.901 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:12:49.901 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:12:49.901 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:12:50.123 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:12:50.124 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:12:50.124 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:12:50.124 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:12:50.418 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:12:50.418 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:12:50.418 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:12:50.418 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:12:50.418 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:12:50.418 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:12:50.418 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:12:50.419 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:12:50.419 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:12:50.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:12:50.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:12:50.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-13T20:12:50.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-13T20:12:50.983 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-13T20:12:50.983 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_fingerprint": "a2930821-eeb4-436a-a84f-154754ab32fa", 2026-02-13T20:12:50.984 INFO:tasks.workunit.client.0.trial030.stdout: "version": "20.3.0-5230-gafefaa40", 2026-02-13T20:12:50.984 INFO:tasks.workunit.client.0.trial030.stdout: "commit": "afefaa40503a4bf024e96f97dd7f852b75f00ad6", 2026-02-13T20:12:50.984 INFO:tasks.workunit.client.0.trial030.stdout: "timestamp": "2026-02-13T20:12:50.984849+0000", 2026-02-13T20:12:50.984 INFO:tasks.workunit.client.0.trial030.stdout: "tag": "", 2026-02-13T20:12:50.984 INFO:tasks.workunit.client.0.trial030.stdout: "health": { 2026-02-13T20:12:50.984 INFO:tasks.workunit.client.0.trial030.stdout: "status": "HEALTH_WARN", 2026-02-13T20:12:50.984 INFO:tasks.workunit.client.0.trial030.stdout: "checks": { 2026-02-13T20:12:50.984 INFO:tasks.workunit.client.0.trial030.stdout: "OSDMAP_FLAGS": { 2026-02-13T20:12:50.984 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-13T20:12:50.984 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-13T20:12:50.984 INFO:tasks.workunit.client.0.trial030.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-13T20:12:50.984 INFO:tasks.workunit.client.0.trial030.stdout: "count": 17 2026-02-13T20:12:50.985 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:50.985 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [], 2026-02-13T20:12:50.985 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-13T20:12:50.985 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:50.985 INFO:tasks.workunit.client.0.trial030.stdout: "OSD_DOWN": { 2026-02-13T20:12:50.985 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-13T20:12:50.985 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-13T20:12:50.985 INFO:tasks.workunit.client.0.trial030.stdout: "message": "1 osds down", 2026-02-13T20:12:50.985 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-13T20:12:50.985 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:50.985 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-13T20:12:50.986 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:50.986 INFO:tasks.workunit.client.0.trial030.stdout: "message": "osd.1 (root=default,host=trial030) is down" 2026-02-13T20:12:50.986 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:50.986 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:50.986 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-13T20:12:50.986 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:50.986 INFO:tasks.workunit.client.0.trial030.stdout: "PG_DEGRADED": { 2026-02-13T20:12:50.986 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-13T20:12:50.986 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-13T20:12:50.986 INFO:tasks.workunit.client.0.trial030.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded, 1 pg undersized", 2026-02-13T20:12:50.986 INFO:tasks.workunit.client.0.trial030.stdout: "count": 2 2026-02-13T20:12:50.986 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:50.987 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-13T20:12:50.987 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:50.987 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.0 is stuck undersized for 60s, current state active+undersized+degraded, last acting [0,2]" 2026-02-13T20:12:50.987 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:50.987 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:50.987 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-13T20:12:50.987 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:50.987 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:50.987 INFO:tasks.workunit.client.0.trial030.stdout: "mutes": [] 2026-02-13T20:12:50.987 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:50.987 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_first_committed": 1, 2026-02-13T20:12:50.987 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_last_committed": 1, 2026-02-13T20:12:50.987 INFO:tasks.workunit.client.0.trial030.stdout: "monmap": { 2026-02-13T20:12:50.988 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-13T20:12:50.988 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "76a1de22-3326-43d1-82f4-48cedec81b31", 2026-02-13T20:12:50.988 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-13T20:11:07.990776Z", 2026-02-13T20:12:50.988 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-13T20:11:07.990776Z", 2026-02-13T20:12:50.988 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release": 20, 2026-02-13T20:12:50.988 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:12:50.988 INFO:tasks.workunit.client.0.trial030.stdout: "election_strategy": 1, 2026-02-13T20:12:50.988 INFO:tasks.workunit.client.0.trial030.stdout: "disallowed_leaders": "", 2026-02-13T20:12:50.988 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": false, 2026-02-13T20:12:50.988 INFO:tasks.workunit.client.0.trial030.stdout: "tiebreaker_mon": "", 2026-02-13T20:12:50.988 INFO:tasks.workunit.client.0.trial030.stdout: "removed_ranks": "", 2026-02-13T20:12:50.988 INFO:tasks.workunit.client.0.trial030.stdout: "features": { 2026-02-13T20:12:50.989 INFO:tasks.workunit.client.0.trial030.stdout: "persistent": [ 2026-02-13T20:12:50.989 INFO:tasks.workunit.client.0.trial030.stdout: "kraken", 2026-02-13T20:12:50.989 INFO:tasks.workunit.client.0.trial030.stdout: "luminous", 2026-02-13T20:12:50.989 INFO:tasks.workunit.client.0.trial030.stdout: "mimic", 2026-02-13T20:12:50.989 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap-prune", 2026-02-13T20:12:50.989 INFO:tasks.workunit.client.0.trial030.stdout: "nautilus", 2026-02-13T20:12:50.989 INFO:tasks.workunit.client.0.trial030.stdout: "octopus", 2026-02-13T20:12:50.989 INFO:tasks.workunit.client.0.trial030.stdout: "pacific", 2026-02-13T20:12:50.989 INFO:tasks.workunit.client.0.trial030.stdout: "elector-pinging", 2026-02-13T20:12:50.989 INFO:tasks.workunit.client.0.trial030.stdout: "quincy", 2026-02-13T20:12:50.989 INFO:tasks.workunit.client.0.trial030.stdout: "reef", 2026-02-13T20:12:50.989 INFO:tasks.workunit.client.0.trial030.stdout: "squid", 2026-02-13T20:12:50.990 INFO:tasks.workunit.client.0.trial030.stdout: "tentacle", 2026-02-13T20:12:50.990 INFO:tasks.workunit.client.0.trial030.stdout: "nvmeof_beacon_diff" 2026-02-13T20:12:50.990 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:50.990 INFO:tasks.workunit.client.0.trial030.stdout: "optional": [] 2026-02-13T20:12:50.990 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:50.990 INFO:tasks.workunit.client.0.trial030.stdout: "mons": [ 2026-02-13T20:12:50.990 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:50.990 INFO:tasks.workunit.client.0.trial030.stdout: "rank": 0, 2026-02-13T20:12:50.990 INFO:tasks.workunit.client.0.trial030.stdout: "name": "a", 2026-02-13T20:12:50.990 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:12:50.990 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:50.990 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:50.990 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:50.991 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115", 2026-02-13T20:12:50.991 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 0 2026-02-13T20:12:50.991 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:50.991 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:50.991 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:50.991 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115/0", 2026-02-13T20:12:50.991 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-13T20:12:50.991 INFO:tasks.workunit.client.0.trial030.stdout: "priority": 0, 2026-02-13T20:12:50.991 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 0, 2026-02-13T20:12:50.991 INFO:tasks.workunit.client.0.trial030.stdout: "time_added": "2026-02-13T20:11:07:990774+0000", 2026-02-13T20:12:50.991 INFO:tasks.workunit.client.0.trial030.stdout: "crush_location": [] 2026-02-13T20:12:50.991 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:50.991 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:50.992 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:50.992 INFO:tasks.workunit.client.0.trial030.stdout: "quorum": [ 2026-02-13T20:12:50.992 INFO:tasks.workunit.client.0.trial030.stdout: 0 2026-02-13T20:12:50.992 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:50.992 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap": { 2026-02-13T20:12:50.992 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 41, 2026-02-13T20:12:50.992 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "76a1de22-3326-43d1-82f4-48cedec81b31", 2026-02-13T20:12:50.992 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-13T20:11:08.074235+0000", 2026-02-13T20:12:50.992 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-13T20:11:50.313749+0000", 2026-02-13T20:12:50.992 INFO:tasks.workunit.client.0.trial030.stdout: "last_up_change": "2026-02-13T20:11:49.292085+0000", 2026-02-13T20:12:50.992 INFO:tasks.workunit.client.0.trial030.stdout: "last_in_change": "2026-02-13T20:11:50.211777+0000", 2026-02-13T20:12:50.992 INFO:tasks.workunit.client.0.trial030.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-13T20:12:50.993 INFO:tasks.workunit.client.0.trial030.stdout: "flags_num": 5800384, 2026-02-13T20:12:50.993 INFO:tasks.workunit.client.0.trial030.stdout: "flags_set": [ 2026-02-13T20:12:50.993 INFO:tasks.workunit.client.0.trial030.stdout: "nodown", 2026-02-13T20:12:50.993 INFO:tasks.workunit.client.0.trial030.stdout: "noin", 2026-02-13T20:12:50.993 INFO:tasks.workunit.client.0.trial030.stdout: "noout", 2026-02-13T20:12:50.993 INFO:tasks.workunit.client.0.trial030.stdout: "pglog_hardlimit", 2026-02-13T20:12:50.993 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snapdirs", 2026-02-13T20:12:50.993 INFO:tasks.workunit.client.0.trial030.stdout: "recovery_deletes", 2026-02-13T20:12:50.993 INFO:tasks.workunit.client.0.trial030.stdout: "sortbitwise" 2026-02-13T20:12:50.993 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:50.993 INFO:tasks.workunit.client.0.trial030.stdout: "crush_version": 9, 2026-02-13T20:12:50.993 INFO:tasks.workunit.client.0.trial030.stdout: "full_ratio": 0.99000000953674316, 2026-02-13T20:12:50.993 INFO:tasks.workunit.client.0.trial030.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-13T20:12:50.994 INFO:tasks.workunit.client.0.trial030.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-13T20:12:50.994 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_snapshot": "", 2026-02-13T20:12:50.994 INFO:tasks.workunit.client.0.trial030.stdout: "pool_max": 1, 2026-02-13T20:12:50.994 INFO:tasks.workunit.client.0.trial030.stdout: "max_osd": 3, 2026-02-13T20:12:50.994 INFO:tasks.workunit.client.0.trial030.stdout: "require_min_compat_client": "luminous", 2026-02-13T20:12:50.994 INFO:tasks.workunit.client.0.trial030.stdout: "min_compat_client": "jewel", 2026-02-13T20:12:50.994 INFO:tasks.workunit.client.0.trial030.stdout: "require_osd_release": "tentacle", 2026-02-13T20:12:50.994 INFO:tasks.workunit.client.0.trial030.stdout: "allow_crimson": false, 2026-02-13T20:12:50.994 INFO:tasks.workunit.client.0.trial030.stdout: "pools": [ 2026-02-13T20:12:50.994 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:50.994 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-13T20:12:50.994 INFO:tasks.workunit.client.0.trial030.stdout: "pool_name": "test", 2026-02-13T20:12:50.994 INFO:tasks.workunit.client.0.trial030.stdout: "create_time": "2026-02-13T20:11:21.340228+0000", 2026-02-13T20:12:50.995 INFO:tasks.workunit.client.0.trial030.stdout: "flags": 1, 2026-02-13T20:12:50.995 INFO:tasks.workunit.client.0.trial030.stdout: "flags_names": "hashpspool", 2026-02-13T20:12:50.995 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-13T20:12:50.995 INFO:tasks.workunit.client.0.trial030.stdout: "size": 3, 2026-02-13T20:12:50.995 INFO:tasks.workunit.client.0.trial030.stdout: "min_size": 2, 2026-02-13T20:12:50.995 INFO:tasks.workunit.client.0.trial030.stdout: "crush_rule": 0, 2026-02-13T20:12:50.995 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_count": 0, 2026-02-13T20:12:50.995 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_target": 0, 2026-02-13T20:12:50.995 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_barrier": 0, 2026-02-13T20:12:50.995 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-13T20:12:50.995 INFO:tasks.workunit.client.0.trial030.stdout: "is_stretch_pool": false, 2026-02-13T20:12:50.995 INFO:tasks.workunit.client.0.trial030.stdout: "object_hash": 2, 2026-02-13T20:12:50.995 INFO:tasks.workunit.client.0.trial030.stdout: "pg_autoscale_mode": "off", 2026-02-13T20:12:50.996 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num": 1, 2026-02-13T20:12:50.996 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num": 1, 2026-02-13T20:12:50.996 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num_target": 1, 2026-02-13T20:12:50.996 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_target": 1, 2026-02-13T20:12:50.996 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_pending": 1, 2026-02-13T20:12:50.996 INFO:tasks.workunit.client.0.trial030.stdout: "last_pg_merge_meta": { 2026-02-13T20:12:50.996 INFO:tasks.workunit.client.0.trial030.stdout: "source_pgid": "0.0", 2026-02-13T20:12:50.996 INFO:tasks.workunit.client.0.trial030.stdout: "ready_epoch": 0, 2026-02-13T20:12:50.996 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_started": 0, 2026-02-13T20:12:50.996 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": 0, 2026-02-13T20:12:50.996 INFO:tasks.workunit.client.0.trial030.stdout: "source_version": "0'0", 2026-02-13T20:12:50.996 INFO:tasks.workunit.client.0.trial030.stdout: "target_version": "0'0" 2026-02-13T20:12:50.997 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:50.997 INFO:tasks.workunit.client.0.trial030.stdout: "last_change": "28", 2026-02-13T20:12:50.997 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend": "0", 2026-02-13T20:12:50.997 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-13T20:12:50.997 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_preluminous": "0", 2026-02-13T20:12:50.997 INFO:tasks.workunit.client.0.trial030.stdout: "auid": 0, 2026-02-13T20:12:50.997 INFO:tasks.workunit.client.0.trial030.stdout: "snap_mode": "selfmanaged", 2026-02-13T20:12:50.997 INFO:tasks.workunit.client.0.trial030.stdout: "snap_seq": 0, 2026-02-13T20:12:50.997 INFO:tasks.workunit.client.0.trial030.stdout: "snap_epoch": 0, 2026-02-13T20:12:50.997 INFO:tasks.workunit.client.0.trial030.stdout: "pool_snaps": [], 2026-02-13T20:12:50.997 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps": "[]", 2026-02-13T20:12:50.997 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_bytes": 0, 2026-02-13T20:12:50.997 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_objects": 0, 2026-02-13T20:12:50.997 INFO:tasks.workunit.client.0.trial030.stdout: "tiers": [], 2026-02-13T20:12:50.998 INFO:tasks.workunit.client.0.trial030.stdout: "tier_of": -1, 2026-02-13T20:12:50.998 INFO:tasks.workunit.client.0.trial030.stdout: "read_tier": -1, 2026-02-13T20:12:50.998 INFO:tasks.workunit.client.0.trial030.stdout: "write_tier": -1, 2026-02-13T20:12:50.998 INFO:tasks.workunit.client.0.trial030.stdout: "cache_mode": "none", 2026-02-13T20:12:50.998 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_bytes": 0, 2026-02-13T20:12:50.998 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_objects": 0, 2026-02-13T20:12:50.998 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-13T20:12:50.998 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-13T20:12:50.998 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-13T20:12:50.998 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_flush_age": 0, 2026-02-13T20:12:50.998 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_evict_age": 0, 2026-02-13T20:12:50.998 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profile": "", 2026-02-13T20:12:50.998 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_params": { 2026-02-13T20:12:50.999 INFO:tasks.workunit.client.0.trial030.stdout: "type": "none" 2026-02-13T20:12:50.999 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:50.999 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_period": 0, 2026-02-13T20:12:50.999 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_count": 0, 2026-02-13T20:12:50.999 INFO:tasks.workunit.client.0.trial030.stdout: "use_gmt_hitset": true, 2026-02-13T20:12:50.999 INFO:tasks.workunit.client.0.trial030.stdout: "min_read_recency_for_promote": 0, 2026-02-13T20:12:50.999 INFO:tasks.workunit.client.0.trial030.stdout: "min_write_recency_for_promote": 0, 2026-02-13T20:12:50.999 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_grade_decay_rate": 0, 2026-02-13T20:12:50.999 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_search_last_n": 0, 2026-02-13T20:12:50.999 INFO:tasks.workunit.client.0.trial030.stdout: "grade_table": [], 2026-02-13T20:12:50.999 INFO:tasks.workunit.client.0.trial030.stdout: "stripe_width": 0, 2026-02-13T20:12:50.999 INFO:tasks.workunit.client.0.trial030.stdout: "expected_num_objects": 0, 2026-02-13T20:12:50.999 INFO:tasks.workunit.client.0.trial030.stdout: "fast_read": false, 2026-02-13T20:12:51.000 INFO:tasks.workunit.client.0.trial030.stdout: "nonprimary_shards": "{}", 2026-02-13T20:12:51.000 INFO:tasks.workunit.client.0.trial030.stdout: "options": {}, 2026-02-13T20:12:51.000 INFO:tasks.workunit.client.0.trial030.stdout: "application_metadata": {}, 2026-02-13T20:12:51.000 INFO:tasks.workunit.client.0.trial030.stdout: "read_balance": { 2026-02-13T20:12:51.000 INFO:tasks.workunit.client.0.trial030.stdout: "score_type": "Fair distribution", 2026-02-13T20:12:51.000 INFO:tasks.workunit.client.0.trial030.stdout: "score_acting": 2.9900000095367432, 2026-02-13T20:12:51.000 INFO:tasks.workunit.client.0.trial030.stdout: "score_stable": 2.9900000095367432, 2026-02-13T20:12:51.000 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_score": 0.67000001668930054, 2026-02-13T20:12:51.000 INFO:tasks.workunit.client.0.trial030.stdout: "raw_score_acting": 2, 2026-02-13T20:12:51.000 INFO:tasks.workunit.client.0.trial030.stdout: "raw_score_stable": 2, 2026-02-13T20:12:51.000 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity_weighted": 1, 2026-02-13T20:12:51.000 INFO:tasks.workunit.client.0.trial030.stdout: "average_primary_affinity": 1, 2026-02-13T20:12:51.000 INFO:tasks.workunit.client.0.trial030.stdout: "average_primary_affinity_weighted": 1 2026-02-13T20:12:51.000 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.001 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.001 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:51.001 INFO:tasks.workunit.client.0.trial030.stdout: "osds": [ 2026-02-13T20:12:51.001 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.001 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:12:51.001 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "21c7ad92-65a7-4d22-99f5-140ea378e021", 2026-02-13T20:12:51.001 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-13T20:12:51.001 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-13T20:12:51.001 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-13T20:12:51.001 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-13T20:12:51.001 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 5, 2026-02-13T20:12:51.001 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 28, 2026-02-13T20:12:51.002 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 35, 2026-02-13T20:12:51.002 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 40, 2026-02-13T20:12:51.002 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 29, 2026-02-13T20:12:51.002 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-13T20:12:51.002 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:12:51.002 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:51.002 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.002 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:51.002 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6800", 2026-02-13T20:12:51.002 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2542521444 2026-02-13T20:12:51.002 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.002 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.002 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:51.003 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6801", 2026-02-13T20:12:51.003 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2542521444 2026-02-13T20:12:51.003 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.003 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:51.003 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.003 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-13T20:12:51.003 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:51.003 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.003 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:51.003 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6802", 2026-02-13T20:12:51.003 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2542521444 2026-02-13T20:12:51.003 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.004 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.004 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:51.004 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6803", 2026-02-13T20:12:51.004 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2542521444 2026-02-13T20:12:51.004 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.004 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:51.004 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.004 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-13T20:12:51.004 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:51.004 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.004 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:51.004 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6806", 2026-02-13T20:12:51.004 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2542521444 2026-02-13T20:12:51.005 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.005 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.005 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:51.005 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6807", 2026-02-13T20:12:51.005 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2542521444 2026-02-13T20:12:51.005 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.005 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:51.005 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.005 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-13T20:12:51.005 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:51.005 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.005 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:51.005 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6804", 2026-02-13T20:12:51.006 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2542521444 2026-02-13T20:12:51.006 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.006 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.006 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:51.006 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6805", 2026-02-13T20:12:51.006 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2542521444 2026-02-13T20:12:51.006 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.006 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:51.006 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.006 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6801/2542521444", 2026-02-13T20:12:51.006 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6803/2542521444", 2026-02-13T20:12:51.006 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6807/2542521444", 2026-02-13T20:12:51.006 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6805/2542521444", 2026-02-13T20:12:51.007 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-13T20:12:51.007 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-13T20:12:51.007 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-13T20:12:51.007 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:51.007 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.007 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.007 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:12:51.007 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "c315988c-ebf1-4438-a258-0f0ea7b0ede6", 2026-02-13T20:12:51.007 INFO:tasks.workunit.client.0.trial030.stdout: "up": 0, 2026-02-13T20:12:51.007 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-13T20:12:51.007 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-13T20:12:51.007 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-13T20:12:51.007 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 0, 2026-02-13T20:12:51.008 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 0, 2026-02-13T20:12:51.008 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 10, 2026-02-13T20:12:51.008 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 22, 2026-02-13T20:12:51.008 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 30, 2026-02-13T20:12:51.008 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-13T20:12:51.008 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:12:51.008 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:51.008 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.008 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:51.008 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-13T20:12:51.008 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2536958630 2026-02-13T20:12:51.008 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.008 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.008 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:51.009 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-13T20:12:51.009 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2536958630 2026-02-13T20:12:51.009 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.009 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:51.009 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.009 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-13T20:12:51.009 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:51.009 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.009 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:51.009 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-13T20:12:51.009 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2536958630 2026-02-13T20:12:51.009 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.009 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.010 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:51.010 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-13T20:12:51.010 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2536958630 2026-02-13T20:12:51.010 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.010 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:51.010 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.010 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-13T20:12:51.010 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:51.010 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.010 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:51.010 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-13T20:12:51.010 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2536958630 2026-02-13T20:12:51.011 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.011 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.011 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:51.011 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-13T20:12:51.011 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2536958630 2026-02-13T20:12:51.011 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.011 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:51.011 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.011 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-13T20:12:51.011 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:51.011 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.011 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:51.011 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-13T20:12:51.012 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2536958630 2026-02-13T20:12:51.012 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.012 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.012 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:51.012 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-13T20:12:51.012 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2536958630 2026-02-13T20:12:51.012 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.012 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:51.012 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.012 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/2536958630", 2026-02-13T20:12:51.012 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/2536958630", 2026-02-13T20:12:51.012 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2536958630", 2026-02-13T20:12:51.012 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2536958630", 2026-02-13T20:12:51.012 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-13T20:12:51.013 INFO:tasks.workunit.client.0.trial030.stdout: "exists" 2026-02-13T20:12:51.013 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:51.013 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.013 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.013 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:12:51.013 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "c311b715-6cd8-404f-b1fc-3a6a779abd75", 2026-02-13T20:12:51.013 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-13T20:12:51.013 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-13T20:12:51.013 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-13T20:12:51.013 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-13T20:12:51.013 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 15, 2026-02-13T20:12:51.013 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 28, 2026-02-13T20:12:51.014 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 37, 2026-02-13T20:12:51.014 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 0, 2026-02-13T20:12:51.014 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 31, 2026-02-13T20:12:51.014 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-13T20:12:51.014 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:12:51.014 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:51.014 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.014 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:51.014 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-13T20:12:51.014 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 42962094 2026-02-13T20:12:51.014 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.014 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.014 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:51.015 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-13T20:12:51.015 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 42962094 2026-02-13T20:12:51.015 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.015 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:51.015 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.015 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-13T20:12:51.015 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:51.015 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.015 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:51.015 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-13T20:12:51.015 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 42962094 2026-02-13T20:12:51.015 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.015 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.015 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:51.016 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-13T20:12:51.016 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 42962094 2026-02-13T20:12:51.016 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.016 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:51.016 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.016 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-13T20:12:51.016 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:51.016 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.016 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:51.016 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-13T20:12:51.016 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 42962094 2026-02-13T20:12:51.016 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.016 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.017 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:51.017 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-13T20:12:51.017 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 42962094 2026-02-13T20:12:51.017 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.017 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:51.017 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.017 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-13T20:12:51.017 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:12:51.017 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.017 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:12:51.017 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-13T20:12:51.017 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 42962094 2026-02-13T20:12:51.018 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.018 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.018 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:12:51.018 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-13T20:12:51.018 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 42962094 2026-02-13T20:12:51.018 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.018 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:51.018 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.018 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/42962094", 2026-02-13T20:12:51.018 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/42962094", 2026-02-13T20:12:51.018 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/42962094", 2026-02-13T20:12:51.018 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/42962094", 2026-02-13T20:12:51.018 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-13T20:12:51.018 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-13T20:12:51.018 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-13T20:12:51.019 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:51.019 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.019 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:51.019 INFO:tasks.workunit.client.0.trial030.stdout: "osd_xinfo": [ 2026-02-13T20:12:51.019 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.019 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:12:51.019 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-13T20:11:44.957817+0000", 2026-02-13T20:12:51.019 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-13T20:12:51.019 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-13T20:12:51.019 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-13T20:12:51.019 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-13T20:12:51.019 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-13T20:11:11.949628+0000", 2026-02-13T20:12:51.019 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-13T20:12:51.019 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.020 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.020 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:12:51.020 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-13T20:11:45.243599+0000", 2026-02-13T20:12:51.020 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-13T20:12:51.020 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-13T20:12:51.020 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-13T20:12:51.020 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-13T20:12:51.020 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-13T20:11:15.343692+0000", 2026-02-13T20:12:51.020 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-13T20:12:51.020 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.020 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.020 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:12:51.020 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-13T20:11:45.524313+0000", 2026-02-13T20:12:51.020 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-13T20:12:51.021 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-13T20:12:51.021 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-13T20:12:51.021 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-13T20:12:51.021 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-13T20:11:19.507288+0000", 2026-02-13T20:12:51.021 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-13T20:12:51.021 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.021 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:51.021 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap": [], 2026-02-13T20:12:51.021 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_items": [], 2026-02-13T20:12:51.021 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_primaries": [], 2026-02-13T20:12:51.021 INFO:tasks.workunit.client.0.trial030.stdout: "pg_temp": [], 2026-02-13T20:12:51.021 INFO:tasks.workunit.client.0.trial030.stdout: "primary_temp": [], 2026-02-13T20:12:51.021 INFO:tasks.workunit.client.0.trial030.stdout: "blocklist": {}, 2026-02-13T20:12:51.021 INFO:tasks.workunit.client.0.trial030.stdout: "range_blocklist": {}, 2026-02-13T20:12:51.022 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profiles": { 2026-02-13T20:12:51.022 INFO:tasks.workunit.client.0.trial030.stdout: "default": { 2026-02-13T20:12:51.022 INFO:tasks.workunit.client.0.trial030.stdout: "k": "2", 2026-02-13T20:12:51.022 INFO:tasks.workunit.client.0.trial030.stdout: "m": "2", 2026-02-13T20:12:51.022 INFO:tasks.workunit.client.0.trial030.stdout: "plugin": "isa", 2026-02-13T20:12:51.022 INFO:tasks.workunit.client.0.trial030.stdout: "technique": "reed_sol_van" 2026-02-13T20:12:51.022 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.022 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.022 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps_queue": [], 2026-02-13T20:12:51.022 INFO:tasks.workunit.client.0.trial030.stdout: "new_removed_snaps": [], 2026-02-13T20:12:51.022 INFO:tasks.workunit.client.0.trial030.stdout: "new_purged_snaps": [], 2026-02-13T20:12:51.022 INFO:tasks.workunit.client.0.trial030.stdout: "crush_node_flags": {}, 2026-02-13T20:12:51.022 INFO:tasks.workunit.client.0.trial030.stdout: "device_class_flags": {}, 2026-02-13T20:12:51.022 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": { 2026-02-13T20:12:51.022 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_enabled": false, 2026-02-13T20:12:51.022 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_bucket_count": 0, 2026-02-13T20:12:51.023 INFO:tasks.workunit.client.0.trial030.stdout: "degraded_stretch_mode": 0, 2026-02-13T20:12:51.023 INFO:tasks.workunit.client.0.trial030.stdout: "recovering_stretch_mode": 0, 2026-02-13T20:12:51.023 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_bucket": 0 2026-02-13T20:12:51.023 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.023 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.023 INFO:tasks.workunit.client.0.trial030.stdout: "osd_metadata": [ 2026-02-13T20:12:51.023 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.023 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:12:51.023 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-13T20:12:51.023 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6802/2542521444,v1:127.0.0.1:6803/2542521444]", 2026-02-13T20:12:51.023 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-13T20:12:51.023 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-13T20:12:51.023 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-13T20:12:51.023 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T20:12:51.023 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-13T20:12:51.023 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T20:12:51.024 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-13T20:12:51.024 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T20:12:51.024 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T20:12:51.024 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T20:12:51.024 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T20:12:51.024 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T20:12:51.024 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-13T20:12:51.024 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T20:12:51.024 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T20:12:51.024 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T20:12:51.024 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T20:12:51.024 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T20:12:51.024 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T20:12:51.024 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-13T20:12:51.024 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-13T20:12:51.024 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:12:51.025 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-13T20:12:51.025 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:12:51.025 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T20:12:51.025 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-13T20:11:09.068498Z", 2026-02-13T20:12:51.025 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-13T20:12:51.025 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-13T20:12:51.025 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T20:12:51.025 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-13T20:12:51.025 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-13T20:12:51.025 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T20:12:51.025 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-13T20:12:51.025 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6800/2542521444,v1:127.0.0.1:6801/2542521444]", 2026-02-13T20:12:51.025 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-13T20:12:51.025 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/2542521444,v1:127.0.0.1:6807/2542521444]", 2026-02-13T20:12:51.025 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/2542521444,v1:127.0.0.1:6805/2542521444]", 2026-02-13T20:12:51.025 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-13T20:12:51.026 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-13T20:12:51.026 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T20:12:51.026 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T20:12:51.026 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-13T20:12:51.026 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961704", 2026-02-13T20:12:51.026 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T20:12:51.026 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-13T20:12:51.026 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-13T20:12:51.026 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-13T20:12:51.026 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/0", 2026-02-13T20:12:51.026 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-13T20:12:51.026 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-13T20:12:51.026 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-13T20:12:51.026 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.026 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.026 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:12:51.026 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-13T20:12:51.027 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/2536958630,v1:127.0.0.1:6813/2536958630]", 2026-02-13T20:12:51.027 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-13T20:12:51.027 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-13T20:12:51.027 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-13T20:12:51.027 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T20:12:51.027 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-13T20:12:51.027 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T20:12:51.027 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-13T20:12:51.027 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T20:12:51.027 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T20:12:51.027 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T20:12:51.027 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T20:12:51.027 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T20:12:51.027 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-13T20:12:51.027 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T20:12:51.027 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T20:12:51.028 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T20:12:51.028 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T20:12:51.028 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T20:12:51.028 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T20:12:51.028 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-13T20:12:51.028 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-13T20:12:51.028 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:12:51.028 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-13T20:12:51.028 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:12:51.028 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T20:12:51.028 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-13T20:11:12.840236Z", 2026-02-13T20:12:51.028 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-13T20:12:51.028 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-13T20:12:51.028 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T20:12:51.028 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-13T20:12:51.028 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-13T20:12:51.028 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T20:12:51.029 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-13T20:12:51.029 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/2536958630,v1:127.0.0.1:6811/2536958630]", 2026-02-13T20:12:51.029 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-13T20:12:51.029 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2536958630,v1:127.0.0.1:6817/2536958630]", 2026-02-13T20:12:51.029 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2536958630,v1:127.0.0.1:6815/2536958630]", 2026-02-13T20:12:51.029 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-13T20:12:51.029 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-13T20:12:51.029 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T20:12:51.029 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T20:12:51.029 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-13T20:12:51.029 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961704", 2026-02-13T20:12:51.029 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T20:12:51.029 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-13T20:12:51.029 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-13T20:12:51.029 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-13T20:12:51.029 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/1", 2026-02-13T20:12:51.029 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-13T20:12:51.029 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-13T20:12:51.030 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-13T20:12:51.030 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.030 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.030 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:12:51.030 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-13T20:12:51.030 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/42962094,v1:127.0.0.1:6813/42962094]", 2026-02-13T20:12:51.030 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-13T20:12:51.030 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-13T20:12:51.030 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-13T20:12:51.030 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T20:12:51.030 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-13T20:12:51.030 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T20:12:51.030 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-13T20:12:51.030 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T20:12:51.030 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T20:12:51.030 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T20:12:51.030 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T20:12:51.031 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T20:12:51.031 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-13T20:12:51.031 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T20:12:51.031 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T20:12:51.031 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T20:12:51.031 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T20:12:51.031 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T20:12:51.031 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T20:12:51.031 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-13T20:12:51.031 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-13T20:12:51.031 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:12:51.031 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-13T20:12:51.031 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:12:51.031 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T20:12:51.031 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-13T20:11:16.940788Z", 2026-02-13T20:12:51.031 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-13T20:12:51.031 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-13T20:12:51.032 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T20:12:51.032 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-13T20:12:51.032 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-13T20:12:51.032 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T20:12:51.032 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-13T20:12:51.032 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/42962094,v1:127.0.0.1:6811/42962094]", 2026-02-13T20:12:51.032 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-13T20:12:51.032 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/42962094,v1:127.0.0.1:6817/42962094]", 2026-02-13T20:12:51.032 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/42962094,v1:127.0.0.1:6815/42962094]", 2026-02-13T20:12:51.032 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-13T20:12:51.032 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-13T20:12:51.032 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T20:12:51.032 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T20:12:51.032 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-13T20:12:51.032 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961704", 2026-02-13T20:12:51.032 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T20:12:51.032 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-13T20:12:51.032 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-13T20:12:51.032 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-13T20:12:51.033 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/2", 2026-02-13T20:12:51.033 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-13T20:12:51.033 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-13T20:12:51.033 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-13T20:12:51.033 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.033 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:51.033 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_clean_epochs": { 2026-02-13T20:12:51.033 INFO:tasks.workunit.client.0.trial030.stdout: "min_last_epoch_clean": 0, 2026-02-13T20:12:51.033 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": { 2026-02-13T20:12:51.033 INFO:tasks.workunit.client.0.trial030.stdout: "per_pool": [] 2026-02-13T20:12:51.033 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.033 INFO:tasks.workunit.client.0.trial030.stdout: "osd_epochs": [ 2026-02-13T20:12:51.033 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.033 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:12:51.033 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 35 2026-02-13T20:12:51.033 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.033 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.033 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:12:51.033 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 38 2026-02-13T20:12:51.033 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.034 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:51.034 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.034 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_first_committed": 1, 2026-02-13T20:12:51.034 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_last_committed": 41, 2026-02-13T20:12:51.034 INFO:tasks.workunit.client.0.trial030.stdout: "crushmap": { 2026-02-13T20:12:51.034 INFO:tasks.workunit.client.0.trial030.stdout: "devices": [ 2026-02-13T20:12:51.034 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.034 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:12:51.034 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.0", 2026-02-13T20:12:51.034 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-13T20:12:51.034 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.034 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.034 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:12:51.034 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.1", 2026-02-13T20:12:51.034 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-13T20:12:51.034 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.034 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.034 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:12:51.034 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.2", 2026-02-13T20:12:51.034 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-13T20:12:51.034 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.035 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:51.035 INFO:tasks.workunit.client.0.trial030.stdout: "types": [ 2026-02-13T20:12:51.035 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.035 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 0, 2026-02-13T20:12:51.035 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd" 2026-02-13T20:12:51.035 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.035 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.035 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-13T20:12:51.035 INFO:tasks.workunit.client.0.trial030.stdout: "name": "host" 2026-02-13T20:12:51.035 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.035 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.035 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 2, 2026-02-13T20:12:51.035 INFO:tasks.workunit.client.0.trial030.stdout: "name": "chassis" 2026-02-13T20:12:51.035 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.035 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.035 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 3, 2026-02-13T20:12:51.035 INFO:tasks.workunit.client.0.trial030.stdout: "name": "rack" 2026-02-13T20:12:51.035 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.035 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.035 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 4, 2026-02-13T20:12:51.035 INFO:tasks.workunit.client.0.trial030.stdout: "name": "row" 2026-02-13T20:12:51.035 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.036 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.036 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 5, 2026-02-13T20:12:51.036 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pdu" 2026-02-13T20:12:51.036 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.036 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.036 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 6, 2026-02-13T20:12:51.036 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pod" 2026-02-13T20:12:51.036 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.036 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.036 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 7, 2026-02-13T20:12:51.036 INFO:tasks.workunit.client.0.trial030.stdout: "name": "room" 2026-02-13T20:12:51.036 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.036 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.036 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 8, 2026-02-13T20:12:51.036 INFO:tasks.workunit.client.0.trial030.stdout: "name": "datacenter" 2026-02-13T20:12:51.036 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.036 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.036 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 9, 2026-02-13T20:12:51.036 INFO:tasks.workunit.client.0.trial030.stdout: "name": "zone" 2026-02-13T20:12:51.036 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.036 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.037 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 10, 2026-02-13T20:12:51.037 INFO:tasks.workunit.client.0.trial030.stdout: "name": "region" 2026-02-13T20:12:51.037 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.037 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.037 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-13T20:12:51.037 INFO:tasks.workunit.client.0.trial030.stdout: "name": "root" 2026-02-13T20:12:51.037 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.037 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:51.037 INFO:tasks.workunit.client.0.trial030.stdout: "buckets": [ 2026-02-13T20:12:51.037 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.037 INFO:tasks.workunit.client.0.trial030.stdout: "id": -1, 2026-02-13T20:12:51.037 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default", 2026-02-13T20:12:51.037 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-13T20:12:51.037 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-13T20:12:51.037 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:12:51.037 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:12:51.037 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:12:51.037 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:12:51.037 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.037 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-13T20:12:51.037 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:12:51.037 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: "id": -2, 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default~ssd", 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030", 2026-02-13T20:12:51.038 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-13T20:12:51.039 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-13T20:12:51.039 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:12:51.039 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:12:51.039 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:12:51.039 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:12:51.039 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.039 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:12:51.039 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:12:51.039 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:12:51.039 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.039 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.039 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:12:51.039 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:12:51.039 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-13T20:12:51.039 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.039 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.039 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:12:51.039 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:12:51.039 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-13T20:12:51.039 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.039 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:51.039 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030~ssd", 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:12:51.040 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: "rules": [ 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: "rule_id": 0, 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: "rule_name": "replicated_rule", 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: "steps": [ 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: "op": "take", 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: "item": -1, 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: "item_name": "default" 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: "op": "choose_firstn", 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: "num": 0, 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: "type": "osd" 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: "op": "emit" 2026-02-13T20:12:51.041 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: "tunables": { 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_tries": 0, 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_fallback_tries": 0, 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: "choose_total_tries": 50, 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_descend_once": 1, 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_vary_r": 1, 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_stable": 1, 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: "msr_descents": 100, 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: "msr_collision_tries": 100, 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: "straw_calc_version": 1, 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: "allowed_bucket_algs": 54, 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: "profile": "jewel", 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_tunables": 1, 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: "legacy_tunables": 0, 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: "minimum_required_version": "jewel", 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables": 1, 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables2": 1, 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: "has_v2_rules": 0, 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables3": 1, 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: "has_v3_rules": 0, 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: "has_v4_buckets": 1, 2026-02-13T20:12:51.042 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables5": 1, 2026-02-13T20:12:51.043 INFO:tasks.workunit.client.0.trial030.stdout: "has_v5_rules": 0, 2026-02-13T20:12:51.043 INFO:tasks.workunit.client.0.trial030.stderr:report 3064932896 2026-02-13T20:12:51.043 INFO:tasks.workunit.client.0.trial030.stdout: "has_msr_rules": 0 2026-02-13T20:12:51.043 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.043 INFO:tasks.workunit.client.0.trial030.stdout: "choose_args": {} 2026-02-13T20:12:51.043 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.043 INFO:tasks.workunit.client.0.trial030.stdout: "fsmap": { 2026-02-13T20:12:51.043 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-13T20:12:51.043 INFO:tasks.workunit.client.0.trial030.stdout: "btime": "2026-02-13T20:11:08:074007+0000", 2026-02-13T20:12:51.043 INFO:tasks.workunit.client.0.trial030.stdout: "default_fscid": -1, 2026-02-13T20:12:51.043 INFO:tasks.workunit.client.0.trial030.stdout: "compat": { 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: "compat": {}, 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: "ro_compat": {}, 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: "incompat": { 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: "feature_1": "base v0.20", 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: "feature_2": "client writeable ranges", 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: "feature_3": "default file layouts on dirs", 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: "feature_4": "dir inode in separate object", 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: "feature_5": "mds uses versioned encoding", 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: "feature_8": "no anchor table", 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: "feature_9": "file layout v2", 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: "feature_10": "snaprealm v2", 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: "feature_11": "minor log segments", 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: "feature_12": "quiesce subvolumes" 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: "feature_flags": { 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: "enable_multiple": true, 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: "ever_enabled_multiple": true 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: "standbys": [], 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: "filesystems": [] 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_first_committed": 1, 2026-02-13T20:12:51.044 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_last_committed": 1, 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "auth": { 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 5, 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "num_secrets": 3 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 1, 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_active": 1, 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_unknown": 0, 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "num_osd": 3, 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "pool_sum": { 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 51688, 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 100, 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 0, 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 300, 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 100, 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 100, 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-13T20:12:51.045 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 101, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 101, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.046 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 0, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 0, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 17, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 17, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "up": 2, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 2, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 0 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum": { 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 3, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83880, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2096, 2026-02-13T20:12:51.047 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 19, 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81708, 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488920, 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036654080, 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2146304, 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 427216, 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 19546, 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83669926 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.048 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum_by_class": { 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "ssd": { 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 3, 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83880, 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2096, 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 19, 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81708, 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488920, 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036654080, 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2146304, 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 427216, 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 19546, 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83669926 2026-02-13T20:12:51.049 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "pool_stats": [ 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": 1, 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 1, 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 51688, 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 100, 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 0, 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 300, 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-13T20:12:51.050 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 100, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 100, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 101, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 101, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-13T20:12:51.051 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 1220608, 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 154528, 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 17, 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 17, 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "up": 2, 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 2, 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 3 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "osd_stats": [ 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 150323855377 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:12:51.052 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 42949672973 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 158913789969 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_state": [ 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: "state": "active+undersized+degraded", 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: "num": 1 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: "pool_pg_unavailable_map": [ 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": "1", 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: "pgs": [] 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_osd": [ 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 1, 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.053 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 0, 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": [ 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": {} 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: "servicemap": { 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 5, 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-13T20:12:50.544116+0000", 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: "services": {} 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_first_committed": 1, 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_last_committed": 52, 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: "logm_first_committed": 1, 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: "logm_last_committed": 275, 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: "paxos": { 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 378, 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: "last_pn": 0, 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: "accepted_pn": 0 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:12:51.054 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-13T20:12:51.055 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-13T20:12:51.055 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:538: TEST_divergent_2: echo 'delay recovery' 2026-02-13T20:12:51.055 INFO:tasks.workunit.client.0.trial030.stdout:delay recovery 2026-02-13T20:12:51.055 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:539: TEST_divergent_2: ceph pg dump pgs 2026-02-13T20:12:51.213 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:12:51.213 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-13T20:11:50.316156+0000 41'101 41:130 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:11:21.364684+0000 0'0 2026-02-13T20:11:21.364684+0000 0 0 periodic scrub scheduled @ 2026-02-14T21:20:00.608467+0000 0 0 2026-02-13T20:12:51.213 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:12:51.213 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:12:51.213 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:12:51.224 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: for i in $non_divergent 2026-02-13T20:12:51.225 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: get_asok_path osd.0 2026-02-13T20:12:51.225 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T20:12:51.225 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T20:12:51.226 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:12:51.226 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:12:51.226 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:12:51.226 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.0.asok 2026-02-13T20:12:51.226 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: CEPH_ARGS= 2026-02-13T20:12:51.226 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.0.asok set_recovery_delay 100000 2026-02-13T20:12:51.290 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T20:12:51.296 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: for i in $non_divergent 2026-02-13T20:12:51.297 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: get_asok_path osd.2 2026-02-13T20:12:51.297 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-13T20:12:51.297 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-13T20:12:51.297 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:12:51.297 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:12:51.297 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:12:51.298 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.2.asok 2026-02-13T20:12:51.298 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: CEPH_ARGS= 2026-02-13T20:12:51.298 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.2.asok set_recovery_delay 100000 2026-02-13T20:12:51.351 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T20:12:51.357 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:546: TEST_divergent_2: echo 'revive divergent 1' 2026-02-13T20:12:51.357 INFO:tasks.workunit.client.0.trial030.stdout:revive divergent 1 2026-02-13T20:12:51.357 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:547: TEST_divergent_2: ceph pg dump pgs 2026-02-13T20:12:51.570 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:12:51.570 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-13T20:11:50.316156+0000 41'101 41:130 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:11:21.364684+0000 0'0 2026-02-13T20:11:21.364684+0000 0 0 periodic scrub scheduled @ 2026-02-14T21:20:00.608467+0000 0 0 2026-02-13T20:12:51.570 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:12:51.571 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:12:51.571 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:12:51.579 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:548: TEST_divergent_2: ceph osd set noup 2026-02-13T20:12:51.909 INFO:tasks.workunit.client.0.trial030.stderr:noup is set 2026-02-13T20:12:51.922 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:549: TEST_divergent_2: activate_osd td/divergent-priors 1 2026-02-13T20:12:51.922 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T20:12:51.922 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T20:12:51.922 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T20:12:51.922 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T20:12:51.922 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-13T20:12:51.922 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:12:51.922 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:12:51.922 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:12:51.922 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:12:51.922 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T20:12:51.922 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T20:12:51.922 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T20:12:51.923 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T20:12:51.923 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:12:51.923 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T20:12:51.923 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:12:51.923 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:12:51.923 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:12:51.923 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:12:51.923 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:12:51.923 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:12:51.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:12:51.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:12:51.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:12:51.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:12:51.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:12:51.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:12:51.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:12:51.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:12:51.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T20:12:51.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T20:12:51.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-13T20:12:51.925 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-13T20:12:51.925 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T20:12:51.925 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:12:51.926 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-13T20:12:51.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T20:12:51.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T20:12:51.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T20:12:51.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T20:12:51.947 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:12:51.946+0000 7fc38bfb3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:12:51.948 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:12:51.946+0000 7fc38bfb3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:12:51.949 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:12:51.946+0000 7fc38bfb3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:12:52.141 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-13T20:12:52.142 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:550: TEST_divergent_2: sleep 5 2026-02-13T20:12:52.352 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:12:52.350+0000 7fc38bfb3a40 -1 Falling back to public interface 2026-02-13T20:12:52.960 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:12:52.958+0000 7fc38bfb3a40 -1 osd.1 28 log_to_monitors true 2026-02-13T20:12:57.143 INFO:tasks.workunit.client.0.trial030.stdout:delay recovery divergent 2026-02-13T20:12:57.143 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:552: TEST_divergent_2: echo 'delay recovery divergent' 2026-02-13T20:12:57.144 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:553: TEST_divergent_2: ceph pg dump pgs 2026-02-13T20:12:57.341 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:12:57.341 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-13T20:11:50.316156+0000 41'101 43:134 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:11:21.364684+0000 0'0 2026-02-13T20:11:21.364684+0000 0 0 periodic scrub scheduled @ 2026-02-14T21:20:00.608467+0000 0 0 2026-02-13T20:12:57.341 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:12:57.342 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:12:57.342 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:12:57.350 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: get_asok_path osd.1 2026-02-13T20:12:57.350 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T20:12:57.350 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T20:12:57.350 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:12:57.351 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:12:57.351 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:12:57.351 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.1.asok 2026-02-13T20:12:57.351 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: CEPH_ARGS= 2026-02-13T20:12:57.352 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.1.asok set_recovery_delay 100000 2026-02-13T20:12:57.407 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T20:12:57.412 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:556: TEST_divergent_2: ceph osd unset noup 2026-02-13T20:12:57.735 INFO:tasks.workunit.client.0.trial030.stderr:noup is unset 2026-02-13T20:12:57.748 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:558: TEST_divergent_2: wait_for_osd up 0 2026-02-13T20:12:57.748 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:12:57.748 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T20:12:57.748 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:12:57.749 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:12:57.749 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:12:57.749 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:12:57.750 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:12:57.750 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:12:57.750 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:12:57.972 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 35 up_thru 40 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/2542521444,v1:127.0.0.1:6801/2542521444] [v2:127.0.0.1:6802/2542521444,v1:127.0.0.1:6803/2542521444] exists,up 21c7ad92-65a7-4d22-99f5-140ea378e021 2026-02-13T20:12:57.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:12:57.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:12:57.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:12:57.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:559: TEST_divergent_2: wait_for_osd up 1 2026-02-13T20:12:57.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:12:57.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T20:12:57.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:12:57.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:12:57.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:12:57.974 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:12:57.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:12:57.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:12:57.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:12:58.186 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 46 up_thru 46 down_at 30 last_clean_interval [10,28) [v2:127.0.0.1:6818/4111838724,v1:127.0.0.1:6819/4111838724] [v2:127.0.0.1:6820/4111838724,v1:127.0.0.1:6821/4111838724] exists,up c315988c-ebf1-4438-a258-0f0ea7b0ede6 2026-02-13T20:12:58.187 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:12:58.188 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:12:58.188 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:12:58.188 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:560: TEST_divergent_2: wait_for_osd up 2 2026-02-13T20:12:58.188 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:12:58.188 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T20:12:58.188 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:12:58.188 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:12:58.188 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:12:58.189 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:12:58.189 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:12:58.189 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:12:58.189 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:12:58.402 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 37 up_thru 0 down_at 31 last_clean_interval [15,28) [v2:127.0.0.1:6810/42962094,v1:127.0.0.1:6811/42962094] [v2:127.0.0.1:6812/42962094,v1:127.0.0.1:6813/42962094] exists,up c311b715-6cd8-404f-b1fc-3a6a779abd75 2026-02-13T20:12:58.403 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:12:58.403 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:12:58.403 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:12:58.403 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:562: TEST_divergent_2: ceph pg dump pgs 2026-02-13T20:12:58.600 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:12:58.600 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 peering 2026-02-13T20:12:57.739418+0000 28'106 46:129 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:11:21.364684+0000 0'0 2026-02-13T20:11:21.364684+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:12:58.601 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:12:58.601 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:12:58.601 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:12:58.609 INFO:tasks.workunit.client.0.trial030.stdout:wait for peering 2026-02-13T20:12:58.609 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:563: TEST_divergent_2: echo 'wait for peering' 2026-02-13T20:12:58.609 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:564: TEST_divergent_2: ceph pg dump pgs 2026-02-13T20:12:58.821 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:12:58.822 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 peering 2026-02-13T20:12:57.739418+0000 28'106 46:129 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:11:21.364684+0000 0'0 2026-02-13T20:11:21.364684+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:12:58.822 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:12:58.822 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:12:58.822 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:12:58.830 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:565: TEST_divergent_2: rados -p test put foo /tmp/tmp.4SiAvSnaJT 2026-02-13T20:12:58.861 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:566: TEST_divergent_2: rm -f /tmp/tmp.4SiAvSnaJT 2026-02-13T20:12:58.862 INFO:tasks.workunit.client.0.trial030.stdout:killing divergent 1 2026-02-13T20:12:58.862 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:570: TEST_divergent_2: echo 'killing divergent 1' 2026-02-13T20:12:58.863 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:571: TEST_divergent_2: ceph pg dump pgs 2026-02-13T20:12:59.073 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:12:59.073 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 peering 2026-02-13T20:12:57.739418+0000 28'106 46:129 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:11:21.364684+0000 0'0 2026-02-13T20:11:21.364684+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:12:59.073 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:12:59.073 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:12:59.074 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:12:59.083 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:572: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd.1 2026-02-13T20:12:59.084 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:12:59.085 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:12:59.085 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:12:59.085 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:12:59.085 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:12:59.193 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:12:59.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:575: TEST_divergent_2: expfile=td/divergent-priors/exp.19555.out 2026-02-13T20:12:59.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:576: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.19555.out 2026-02-13T20:12:59.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-13T20:12:59.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T20:12:59.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-13T20:12:59.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T20:12:59.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-13T20:12:59.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.19555.out 2026-02-13T20:12:59.380 INFO:tasks.workunit.client.0.trial030.stderr:Exporting 1.0 info 1.0( v 47'102 lc 0'0 (28'90,47'102] local-lis/les=46/47 n=101 ec=22/22 lis/c=46/22 les/c/f=47/23/0 sis=46) 2026-02-13T20:12:59.395 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:023dd3d2:::existing_12:head# 2026-02-13T20:12:59.396 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:04c40a0c:::existing_93:head# 2026-02-13T20:12:59.396 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:064ff5fb:::existing_36:head# 2026-02-13T20:12:59.396 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:091f9f1d:::existing_94:head# 2026-02-13T20:12:59.396 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:0a865a93:::existing_54:head# 2026-02-13T20:12:59.396 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:0fed513c:::existing_41:head# 2026-02-13T20:12:59.396 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:13b9e0b8:::existing_92:head# 2026-02-13T20:12:59.396 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:169157fa:::existing_81:head# 2026-02-13T20:12:59.396 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:17731382:::existing_58:head# 2026-02-13T20:12:59.396 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:18a45a39:::existing_43:head# 2026-02-13T20:12:59.396 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:1c160f01:::existing_66:head# 2026-02-13T20:12:59.397 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:1dd6c249:::existing_97:head# 2026-02-13T20:12:59.397 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:227e0c77:::existing_7:head# 2026-02-13T20:12:59.397 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:23e1b063:::existing_59:head# 2026-02-13T20:12:59.397 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:28566edb:::existing_78:head# 2026-02-13T20:12:59.397 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:2a101182:::existing_20:head# 2026-02-13T20:12:59.397 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:2d1519da:::existing_96:head# 2026-02-13T20:12:59.397 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:3078b87a:::existing_86:head# 2026-02-13T20:12:59.397 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:30bde01b:::existing_15:head# 2026-02-13T20:12:59.397 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:317a7e19:::existing_56:head# 2026-02-13T20:12:59.397 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:38b9c7fa:::existing_33:head# 2026-02-13T20:12:59.397 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:3e16d84b:::existing_48:head# 2026-02-13T20:12:59.397 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:45fe8203:::existing_75:head# 2026-02-13T20:12:59.397 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:4e82c9ba:::existing_50:head# 2026-02-13T20:12:59.398 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:5298dcdb:::existing_57:head# 2026-02-13T20:12:59.398 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:52ebaa44:::existing_32:head# 2026-02-13T20:12:59.398 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:53588912:::existing_9:head# 2026-02-13T20:12:59.398 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:5b7e2de6:::existing_84:head# 2026-02-13T20:12:59.398 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:5da0255c:::existing_13:head# 2026-02-13T20:12:59.398 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:5da2dab8:::existing_53:head# 2026-02-13T20:12:59.398 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:5ee3514b:::existing_30:head# 2026-02-13T20:12:59.398 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:602f83fe:::foo:head# 2026-02-13T20:12:59.398 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:60426cc7:::existing_62:head# 2026-02-13T20:12:59.398 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:628918ca:::existing_79:head# 2026-02-13T20:12:59.398 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:63f8ab2d:::existing_77:head# 2026-02-13T20:12:59.398 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:67e1780f:::existing_27:head# 2026-02-13T20:12:59.398 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:68143ca1:::existing_71:head# 2026-02-13T20:12:59.399 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:6bac9509:::existing_29:head# 2026-02-13T20:12:59.399 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:6bbec798:::existing_45:head# 2026-02-13T20:12:59.399 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:6cb23a40:::existing_65:head# 2026-02-13T20:12:59.399 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:7055ec5e:::existing_83:head# 2026-02-13T20:12:59.399 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:70a54e2b:::existing_87:head# 2026-02-13T20:12:59.399 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:750ace21:::existing_19:head# 2026-02-13T20:12:59.399 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:78623b1d:::existing_6:head# 2026-02-13T20:12:59.399 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:79881152:::existing_63:head# 2026-02-13T20:12:59.399 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:7a80c0d5:::existing_99:head# 2026-02-13T20:12:59.399 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:81490677:::existing_76:head# 2026-02-13T20:12:59.399 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:85ec8e5d:::existing_85:head# 2026-02-13T20:12:59.399 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:8e2abbf0:::existing_49:head# 2026-02-13T20:12:59.399 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:8ee0fe0f:::existing_52:head# 2026-02-13T20:12:59.400 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:923c5d4d:::existing_5:head# 2026-02-13T20:12:59.400 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:92731e71:::existing_89:head# 2026-02-13T20:12:59.400 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:928205cf:::existing_82:head# 2026-02-13T20:12:59.400 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:93be2267:::existing_24:head# 2026-02-13T20:12:59.400 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:99ceda2c:::existing_44:head# 2026-02-13T20:12:59.400 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:9dd917ee:::existing_26:head# 2026-02-13T20:12:59.400 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:a28805a6:::existing_72:head# 2026-02-13T20:12:59.400 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:a294a8f6:::existing_16:head# 2026-02-13T20:12:59.400 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:a2f5473a:::existing_42:head# 2026-02-13T20:12:59.400 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:a504a533:::existing_90:head# 2026-02-13T20:12:59.400 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:a691337e:::existing_61:head# 2026-02-13T20:12:59.400 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:a6e8d7ac:::existing_28:head# 2026-02-13T20:12:59.401 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:a9fde86e:::existing_18:head# 2026-02-13T20:12:59.401 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:aa309faa:::existing_68:head# 2026-02-13T20:12:59.401 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:ae40b0ed:::existing_31:head# 2026-02-13T20:12:59.401 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:b279b1fe:::existing_10:head# 2026-02-13T20:12:59.401 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:b343e277:::existing_88:head# 2026-02-13T20:12:59.401 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:b7130e90:::existing_80:head# 2026-02-13T20:12:59.401 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:bc6f7309:::existing_70:head# 2026-02-13T20:12:59.401 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:be8489b7:::existing_38:head# 2026-02-13T20:12:59.401 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:beb4e5e3:::existing_47:head# 2026-02-13T20:12:59.401 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:bebec877:::existing_74:head# 2026-02-13T20:12:59.401 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:c04347d8:::existing_60:head# 2026-02-13T20:12:59.401 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:c156033e:::existing_100:head# 2026-02-13T20:12:59.401 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:c19f5a8e:::existing_8:head# 2026-02-13T20:12:59.402 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:c3e6ebe4:::existing_17:head# 2026-02-13T20:12:59.402 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:c6c5a7c2:::existing_39:head# 2026-02-13T20:12:59.402 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:cc1d0abf:::existing_95:head# 2026-02-13T20:12:59.402 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:ccb3865b:::existing_73:head# 2026-02-13T20:12:59.402 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:cd84e19e:::existing_40:head# 2026-02-13T20:12:59.402 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:d2cd64ce:::existing_37:head# 2026-02-13T20:12:59.402 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:d41a25c9:::existing_22:head# 2026-02-13T20:12:59.402 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:d7f088da:::existing_91:head# 2026-02-13T20:12:59.402 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:d9cbd1d6:::existing_64:head# 2026-02-13T20:12:59.402 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:dcc4ff82:::existing_98:head# 2026-02-13T20:12:59.402 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:dd677bd3:::existing_35:head# 2026-02-13T20:12:59.405 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:dd6d90e7:::existing_46:head# 2026-02-13T20:12:59.405 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:e0e22077:::existing_21:head# 2026-02-13T20:12:59.405 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:e255b710:::existing_55:head# 2026-02-13T20:12:59.405 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:eff1d5db:::existing_14:head# 2026-02-13T20:12:59.405 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:f1b156bf:::existing_23:head# 2026-02-13T20:12:59.405 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:f5ce4199:::existing_34:head# 2026-02-13T20:12:59.405 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:f6809456:::existing_11:head# 2026-02-13T20:12:59.405 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:f699a2a9:::existing_67:head# 2026-02-13T20:12:59.405 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:f9baac43:::existing_25:head# 2026-02-13T20:12:59.405 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:fb76688e:::existing_51:head# 2026-02-13T20:12:59.406 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:fbb92eec:::existing_69:head# 2026-02-13T20:12:59.406 INFO:tasks.workunit.client.0.trial030.stderr:Export successful 2026-02-13T20:12:59.406 INFO:tasks.workunit.client.0.trial030.stdout: marking collection for removal 2026-02-13T20:12:59.406 INFO:tasks.workunit.client.0.trial030.stdout:setting '_remove' omap key 2026-02-13T20:12:59.406 INFO:tasks.workunit.client.0.trial030.stdout:finish_remove_pgs 1.0_head removing 1.0 2026-02-13T20:12:59.407 INFO:tasks.workunit.client.0.trial030.stderr:Remove successful 2026-02-13T20:12:59.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:577: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.19555.out 2026-02-13T20:12:59.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-13T20:12:59.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T20:12:59.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-13T20:12:59.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T20:12:59.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-13T20:12:59.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.19555.out 2026-02-13T20:12:59.670 INFO:tasks.workunit.client.0.trial030.stdout:get_pg_num_history pg_num_history pg_num_history(e47 pg_nums {1={22=1}} deleted_pools ) 2026-02-13T20:12:59.671 INFO:tasks.workunit.client.0.trial030.stdout:Importing pgid 1.0 2026-02-13T20:12:59.671 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:023dd3d2:::existing_12:head# 2026-02-13T20:12:59.671 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.671 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:04c40a0c:::existing_93:head# 2026-02-13T20:12:59.671 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.671 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:064ff5fb:::existing_36:head# 2026-02-13T20:12:59.671 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.671 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:091f9f1d:::existing_94:head# 2026-02-13T20:12:59.671 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.671 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:0a865a93:::existing_54:head# 2026-02-13T20:12:59.672 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.672 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:0fed513c:::existing_41:head# 2026-02-13T20:12:59.672 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.672 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:13b9e0b8:::existing_92:head# 2026-02-13T20:12:59.672 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.672 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:169157fa:::existing_81:head# 2026-02-13T20:12:59.672 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.672 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:17731382:::existing_58:head# 2026-02-13T20:12:59.672 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.672 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:18a45a39:::existing_43:head# 2026-02-13T20:12:59.672 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.673 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:1c160f01:::existing_66:head# 2026-02-13T20:12:59.673 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.673 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:1dd6c249:::existing_97:head# 2026-02-13T20:12:59.673 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.673 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:227e0c77:::existing_7:head# 2026-02-13T20:12:59.673 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.673 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:23e1b063:::existing_59:head# 2026-02-13T20:12:59.673 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.673 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:28566edb:::existing_78:head# 2026-02-13T20:12:59.673 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.673 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:2a101182:::existing_20:head# 2026-02-13T20:12:59.673 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.674 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:2d1519da:::existing_96:head# 2026-02-13T20:12:59.674 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.674 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:3078b87a:::existing_86:head# 2026-02-13T20:12:59.674 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.674 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:30bde01b:::existing_15:head# 2026-02-13T20:12:59.674 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.674 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:317a7e19:::existing_56:head# 2026-02-13T20:12:59.674 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.674 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:38b9c7fa:::existing_33:head# 2026-02-13T20:12:59.674 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.674 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:3e16d84b:::existing_48:head# 2026-02-13T20:12:59.674 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.674 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:45fe8203:::existing_75:head# 2026-02-13T20:12:59.675 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.675 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:4e82c9ba:::existing_50:head# 2026-02-13T20:12:59.675 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.675 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:5298dcdb:::existing_57:head# 2026-02-13T20:12:59.675 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.675 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:52ebaa44:::existing_32:head# 2026-02-13T20:12:59.675 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.675 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:53588912:::existing_9:head# 2026-02-13T20:12:59.675 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.675 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:5b7e2de6:::existing_84:head# 2026-02-13T20:12:59.675 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.675 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:5da0255c:::existing_13:head# 2026-02-13T20:12:59.676 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.676 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:5da2dab8:::existing_53:head# 2026-02-13T20:12:59.676 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.676 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:5ee3514b:::existing_30:head# 2026-02-13T20:12:59.676 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.676 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:602f83fe:::foo:head# 2026-02-13T20:12:59.676 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.676 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:60426cc7:::existing_62:head# 2026-02-13T20:12:59.676 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.676 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:628918ca:::existing_79:head# 2026-02-13T20:12:59.676 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.676 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:63f8ab2d:::existing_77:head# 2026-02-13T20:12:59.677 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.677 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:67e1780f:::existing_27:head# 2026-02-13T20:12:59.677 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.677 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:68143ca1:::existing_71:head# 2026-02-13T20:12:59.677 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.677 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:6bac9509:::existing_29:head# 2026-02-13T20:12:59.677 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.677 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:6bbec798:::existing_45:head# 2026-02-13T20:12:59.677 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.677 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:6cb23a40:::existing_65:head# 2026-02-13T20:12:59.677 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.677 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:7055ec5e:::existing_83:head# 2026-02-13T20:12:59.677 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.678 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:70a54e2b:::existing_87:head# 2026-02-13T20:12:59.678 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.678 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:750ace21:::existing_19:head# 2026-02-13T20:12:59.678 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.678 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:78623b1d:::existing_6:head# 2026-02-13T20:12:59.678 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.678 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:79881152:::existing_63:head# 2026-02-13T20:12:59.678 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.678 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:7a80c0d5:::existing_99:head# 2026-02-13T20:12:59.678 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.678 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:81490677:::existing_76:head# 2026-02-13T20:12:59.678 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.679 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:85ec8e5d:::existing_85:head# 2026-02-13T20:12:59.679 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.679 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:8e2abbf0:::existing_49:head# 2026-02-13T20:12:59.679 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.679 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:8ee0fe0f:::existing_52:head# 2026-02-13T20:12:59.679 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.679 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:923c5d4d:::existing_5:head# 2026-02-13T20:12:59.679 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.679 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:92731e71:::existing_89:head# 2026-02-13T20:12:59.679 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.679 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:928205cf:::existing_82:head# 2026-02-13T20:12:59.679 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.679 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:93be2267:::existing_24:head# 2026-02-13T20:12:59.680 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.680 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:99ceda2c:::existing_44:head# 2026-02-13T20:12:59.680 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.680 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:9dd917ee:::existing_26:head# 2026-02-13T20:12:59.680 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.680 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:a28805a6:::existing_72:head# 2026-02-13T20:12:59.680 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.680 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:a294a8f6:::existing_16:head# 2026-02-13T20:12:59.680 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.681 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:a2f5473a:::existing_42:head# 2026-02-13T20:12:59.681 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.681 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:a504a533:::existing_90:head# 2026-02-13T20:12:59.681 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.681 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:a691337e:::existing_61:head# 2026-02-13T20:12:59.681 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.681 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:a6e8d7ac:::existing_28:head# 2026-02-13T20:12:59.682 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.682 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:a9fde86e:::existing_18:head# 2026-02-13T20:12:59.682 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.682 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:aa309faa:::existing_68:head# 2026-02-13T20:12:59.682 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.682 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:ae40b0ed:::existing_31:head# 2026-02-13T20:12:59.682 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.682 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:b279b1fe:::existing_10:head# 2026-02-13T20:12:59.682 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.682 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:b343e277:::existing_88:head# 2026-02-13T20:12:59.683 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.683 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:b7130e90:::existing_80:head# 2026-02-13T20:12:59.683 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.683 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:bc6f7309:::existing_70:head# 2026-02-13T20:12:59.683 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.683 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:be8489b7:::existing_38:head# 2026-02-13T20:12:59.683 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.683 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:beb4e5e3:::existing_47:head# 2026-02-13T20:12:59.683 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.683 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:bebec877:::existing_74:head# 2026-02-13T20:12:59.683 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.683 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:c04347d8:::existing_60:head# 2026-02-13T20:12:59.683 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.684 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:c156033e:::existing_100:head# 2026-02-13T20:12:59.684 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.684 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:c19f5a8e:::existing_8:head# 2026-02-13T20:12:59.684 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.684 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:c3e6ebe4:::existing_17:head# 2026-02-13T20:12:59.684 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.684 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:c6c5a7c2:::existing_39:head# 2026-02-13T20:12:59.684 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.684 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:cc1d0abf:::existing_95:head# 2026-02-13T20:12:59.684 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.684 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:ccb3865b:::existing_73:head# 2026-02-13T20:12:59.684 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.685 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:cd84e19e:::existing_40:head# 2026-02-13T20:12:59.685 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.685 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:d2cd64ce:::existing_37:head# 2026-02-13T20:12:59.685 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.685 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:d41a25c9:::existing_22:head# 2026-02-13T20:12:59.685 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.685 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:d7f088da:::existing_91:head# 2026-02-13T20:12:59.685 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.686 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:d9cbd1d6:::existing_64:head# 2026-02-13T20:12:59.686 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.686 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:dcc4ff82:::existing_98:head# 2026-02-13T20:12:59.686 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.686 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:dd677bd3:::existing_35:head# 2026-02-13T20:12:59.686 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.687 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:dd6d90e7:::existing_46:head# 2026-02-13T20:12:59.687 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.687 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:e0e22077:::existing_21:head# 2026-02-13T20:12:59.687 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.687 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:e255b710:::existing_55:head# 2026-02-13T20:12:59.687 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.688 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:eff1d5db:::existing_14:head# 2026-02-13T20:12:59.688 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.688 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:f1b156bf:::existing_23:head# 2026-02-13T20:12:59.688 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.688 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:f5ce4199:::existing_34:head# 2026-02-13T20:12:59.688 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.688 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:f6809456:::existing_11:head# 2026-02-13T20:12:59.688 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.688 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:f699a2a9:::existing_67:head# 2026-02-13T20:12:59.689 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.689 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:f9baac43:::existing_25:head# 2026-02-13T20:12:59.689 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.689 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:fb76688e:::existing_51:head# 2026-02-13T20:12:59.689 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.689 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:fbb92eec:::existing_69:head# 2026-02-13T20:12:59.689 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:12:59.690 INFO:tasks.workunit.client.0.trial030.stdout:write_pg epoch 47 info 1.0( v 47'102 lc 0'0 (28'90,47'102] local-lis/les=46/47 n=101 ec=22/22 lis/c=46/22 les/c/f=47/23/0 sis=46) 2026-02-13T20:12:59.690 INFO:tasks.workunit.client.0.trial030.stdout:Import successful 2026-02-13T20:12:59.767 INFO:tasks.workunit.client.0.trial030.stdout:reviving divergent 1 2026-02-13T20:12:59.768 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:579: TEST_divergent_2: echo 'reviving divergent 1' 2026-02-13T20:12:59.768 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:580: TEST_divergent_2: ceph pg dump pgs 2026-02-13T20:12:59.973 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:12:59.973 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 peering 2026-02-13T20:12:57.739418+0000 28'106 46:129 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:11:21.364684+0000 0'0 2026-02-13T20:11:21.364684+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:12:59.973 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:12:59.974 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:12:59.974 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:12:59.988 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:581: TEST_divergent_2: activate_osd td/divergent-priors 1 2026-02-13T20:12:59.988 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T20:12:59.988 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T20:12:59.988 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T20:12:59.988 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T20:12:59.989 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-13T20:12:59.989 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:12:59.989 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:12:59.989 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:12:59.989 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:12:59.990 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T20:12:59.990 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T20:12:59.990 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T20:12:59.990 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T20:12:59.990 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:12:59.990 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T20:12:59.991 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:12:59.991 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:12:59.991 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:12:59.991 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:12:59.991 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:12:59.991 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:12:59.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:12:59.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:12:59.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:12:59.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:12:59.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:12:59.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:12:59.993 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:12:59.993 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:12:59.993 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T20:12:59.993 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T20:12:59.993 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-13T20:12:59.993 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T20:12:59.994 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-13T20:12:59.995 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:12:59.996 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-13T20:12:59.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T20:12:59.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T20:12:59.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T20:12:59.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T20:13:00.012 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:00.009+0000 7fddf88cda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:13:00.013 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:00.009+0000 7fddf88cda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:13:00.014 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:00.009+0000 7fddf88cda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:13:00.212 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-13T20:13:00.213 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:13:00.213 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T20:13:00.213 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:13:00.213 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:13:00.213 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:13:00.213 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:13:00.214 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:13:00.214 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:13:00.214 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:13:00.416 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:00.413+0000 7fddf88cda40 -1 Falling back to public interface 2026-02-13T20:13:00.437 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 46 up_thru 46 down_at 30 last_clean_interval [10,28) [v2:127.0.0.1:6818/4111838724,v1:127.0.0.1:6819/4111838724] [v2:127.0.0.1:6820/4111838724,v1:127.0.0.1:6821/4111838724] exists,up c315988c-ebf1-4438-a258-0f0ea7b0ede6 2026-02-13T20:13:00.438 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:13:00.438 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:13:00.438 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:13:00.438 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:582: TEST_divergent_2: wait_for_osd up 1 2026-02-13T20:13:00.438 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:13:00.438 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T20:13:00.438 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:13:00.439 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:13:00.439 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:13:00.439 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:13:00.439 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:13:00.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:13:00.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:13:00.654 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 46 up_thru 46 down_at 30 last_clean_interval [10,28) [v2:127.0.0.1:6818/4111838724,v1:127.0.0.1:6819/4111838724] [v2:127.0.0.1:6820/4111838724,v1:127.0.0.1:6821/4111838724] exists,up c315988c-ebf1-4438-a258-0f0ea7b0ede6 2026-02-13T20:13:00.655 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:13:00.655 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:13:00.655 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:13:00.656 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:584: TEST_divergent_2: sleep 20 2026-02-13T20:13:01.070 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:01.065+0000 7fddf88cda40 -1 osd.1 47 log_to_monitors true 2026-02-13T20:13:20.657 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: get_asok_path osd.1 2026-02-13T20:13:20.658 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T20:13:20.658 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T20:13:20.659 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:13:20.659 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:13:20.659 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:13:20.659 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.1.asok 2026-02-13T20:13:20.659 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: CEPH_ARGS= 2026-02-13T20:13:20.659 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.1.asok dump_ops_in_flight 2026-02-13T20:13:20.721 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-13T20:13:20.721 INFO:tasks.workunit.client.0.trial030.stdout: "ops": [], 2026-02-13T20:13:20.721 INFO:tasks.workunit.client.0.trial030.stdout: "num_ops": 0 2026-02-13T20:13:20.722 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-13T20:13:20.727 INFO:tasks.workunit.client.0.trial030.stdout:allowing recovery 2026-02-13T20:13:20.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:587: TEST_divergent_2: echo 'allowing recovery' 2026-02-13T20:13:20.728 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:588: TEST_divergent_2: ceph pg dump pgs 2026-02-13T20:13:20.940 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:13:20.940 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 0 0 0 0 52200 0 0 12 90 12 active+clean 2026-02-13T20:13:01.596565+0000 47'102 51:160 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:11:21.364684+0000 0'0 2026-02-13T20:11:21.364684+0000 0 0 periodic scrub scheduled @ 2026-02-15T03:05:35.265292+0000 0 0 2026-02-13T20:13:20.940 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:13:20.940 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:13:20.941 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:13:20.949 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-13T20:13:20.949 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-13T20:13:21.038 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T20:13:21.045 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-13T20:13:21.046 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-13T20:13:21.129 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T20:13:21.136 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-13T20:13:21.136 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-13T20:13:21.217 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T20:13:21.224 INFO:tasks.workunit.client.0.trial030.stdout:reading divergent objects 2026-02-13T20:13:21.224 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:595: TEST_divergent_2: echo 'reading divergent objects' 2026-02-13T20:13:21.225 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:596: TEST_divergent_2: ceph pg dump pgs 2026-02-13T20:13:21.438 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:13:21.439 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 0 0 0 0 52200 0 0 12 90 12 active+clean 2026-02-13T20:13:01.596565+0000 47'102 51:160 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:11:21.364684+0000 0'0 2026-02-13T20:11:21.364684+0000 0 0 periodic scrub scheduled @ 2026-02-15T03:05:35.265292+0000 0 0 2026-02-13T20:13:21.439 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:13:21.439 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:13:21.439 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:13:21.448 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: expr 2 + 2 2026-02-13T20:13:21.449 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: seq 1 4 2026-02-13T20:13:21.451 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T20:13:21.451 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_1 td/divergent-priors/existing 2026-02-13T20:13:21.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T20:13:21.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_2 td/divergent-priors/existing 2026-02-13T20:13:21.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T20:13:21.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_3 td/divergent-priors/existing 2026-02-13T20:13:21.526 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T20:13:21.527 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_4 td/divergent-priors/existing 2026-02-13T20:13:21.556 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: seq 1 2 2026-02-13T20:13:21.557 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-13T20:13:21.558 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:603: TEST_divergent_2: rados -p test get newobject_1 td/divergent-priors/existing 2026-02-13T20:13:21.577 INFO:tasks.workunit.client.0.trial030.stderr:error getting test/newobject_1: (2) No such file or directory 2026-02-13T20:13:21.579 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-13T20:13:21.579 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:603: TEST_divergent_2: rados -p test get newobject_2 td/divergent-priors/existing 2026-02-13T20:13:21.606 INFO:tasks.workunit.client.0.trial030.stderr:error getting test/newobject_2: (2) No such file or directory 2026-02-13T20:13:21.607 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:605: TEST_divergent_2: rm -f td/divergent-priors/existing 2026-02-13T20:13:21.609 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:607: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-13T20:13:21.610 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:607: TEST_divergent_2: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-13T20:13:21.613 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 28'106 (28'4) delete 1:70b3bf12:::existing_4:head by client.4547.0:1 2026-02-13T20:11:34.403576+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-13T20:13:21.613 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 20 _merge_object_divergent_entries: keeping 28'106 (28'4) delete 1:70b3bf12:::existing_4:head by client.4547.0:1 2026-02-13T20:11:34.403576+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-13T20:13:21.613 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T20:13:21.613 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 28'4 first_divergent_update: 28'106 last_divergent_update: 28'106 2026-02-13T20:13:21.613 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: more recent entry found: 41'101 (28'4) modify 1:70b3bf12:::existing_4:head by client.4658.0:1 2026-02-13T20:12:21.334117+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false, already merged 2026-02-13T20:13:21.614 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 28'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4537.0:1 2026-02-13T20:11:34.396691+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-13T20:13:21.614 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 20 _merge_object_divergent_entries: keeping 28'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4537.0:1 2026-02-13T20:11:34.396691+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-13T20:13:21.614 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T20:13:21.614 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 28'101 last_divergent_update: 28'101 2026-02-13T20:13:21.614 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2026-02-13T20:13:21.614 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2026-02-13T20:13:21.614 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4545.0:1 2026-02-13T20:11:34.401833+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-13T20:13:21.614 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 20 _merge_object_divergent_entries: keeping 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4545.0:1 2026-02-13T20:11:34.401833+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-13T20:13:21.614 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2026-02-13T20:13:21.614 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 28'3 first_divergent_update: 28'105 last_divergent_update: 28'105 2026-02-13T20:13:21.614 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2026-02-13T20:13:21.615 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2026-02-13T20:13:21.615 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 28'106 2026-02-13T20:13:21.615 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4545.0:1 2026-02-13T20:11:34.401833+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-13T20:13:21.615 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2026-02-13T20:13:21.615 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 28'3 <= info.log_tail 28'90 2026-02-13T20:13:21.615 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 28'104 (28'2) modify 1:97db2a0f:::existing_2:head by client.4541.0:1 2026-02-13T20:11:34.398327+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T20:13:21.615 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 20 _merge_object_divergent_entries: keeping 28'104 (28'2) modify 1:97db2a0f:::existing_2:head by client.4541.0:1 2026-02-13T20:11:34.398327+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T20:13:21.615 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T20:13:21.615 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 28'2 first_divergent_update: 28'104 last_divergent_update: 28'104 2026-02-13T20:13:21.615 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2026-02-13T20:13:21.615 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2026-02-13T20:13:21.616 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 28'106 2026-02-13T20:13:21.616 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 28'104 (28'2) modify 1:97db2a0f:::existing_2:head by client.4541.0:1 2026-02-13T20:11:34.398327+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T20:13:21.616 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2026-02-13T20:13:21.616 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 28'2 <= info.log_tail 28'90 2026-02-13T20:13:21.616 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 28'102 (28'1) modify 1:d858c035:::existing_1:head by client.4539.0:1 2026-02-13T20:11:34.397361+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T20:13:21.616 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 20 _merge_object_divergent_entries: keeping 28'102 (28'1) modify 1:d858c035:::existing_1:head by client.4539.0:1 2026-02-13T20:11:34.397361+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T20:13:21.617 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T20:13:21.617 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 28'1 first_divergent_update: 28'102 last_divergent_update: 28'102 2026-02-13T20:13:21.617 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2026-02-13T20:13:21.617 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2026-02-13T20:13:21.617 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 28'106 2026-02-13T20:13:21.617 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 28'102 (28'1) modify 1:d858c035:::existing_1:head by client.4539.0:1 2026-02-13T20:11:34.397361+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T20:13:21.617 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2026-02-13T20:13:21.618 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 28'1 <= info.log_tail 28'90 2026-02-13T20:13:21.618 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 28'103 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4540.0:1 2026-02-13T20:11:34.397572+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-13T20:13:21.618 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 20 _merge_object_divergent_entries: keeping 28'103 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4540.0:1 2026-02-13T20:11:34.397572+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-13T20:13:21.618 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T20:13:21.618 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 28'103 last_divergent_update: 28'103 2026-02-13T20:13:21.618 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2026-02-13T20:13:21.618 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:12:58.161+0000 7fc369f31640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2026-02-13T20:13:21.619 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:609: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-13T20:13:21.619 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:609: TEST_divergent_2: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-13T20:13:21.619 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:615: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-13T20:13:21.620 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:615: TEST_divergent_2: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-13T20:13:21.623 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:620: TEST_divergent_2: echo success 2026-02-13T20:13:21.623 INFO:tasks.workunit.client.0.trial030.stdout:success 2026-02-13T20:13:21.624 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:622: TEST_divergent_2: rm td/divergent-priors/td/divergent-priors/exp.19555.out 2026-02-13T20:13:21.625 INFO:tasks.workunit.client.0.trial030.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.19555.out': No such file or directory 2026-02-13T20:13:21.625 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:623: TEST_divergent_2: delete_pool test 2026-02-13T20:13:21.625 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-13T20:13:21.625 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-13T20:13:21.892 INFO:tasks.workunit.client.0.trial030.stderr:pool 'test' does not exist 2026-02-13T20:13:21.902 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:624: TEST_divergent_2: kill_daemons td/divergent-priors 2026-02-13T20:13:21.903 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:13:21.903 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:13:21.903 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:13:21.903 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:13:21.903 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:13:27.218 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:13:27.218 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-13T20:13:27.219 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-13T20:13:27.219 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T20:13:27.219 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-13T20:13:27.219 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:13:27.219 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:13:27.220 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:13:27.220 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:13:27.220 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:13:27.225 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:13:27.225 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T20:13:27.226 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T20:13:27.227 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T20:13:27.228 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T20:13:27.228 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T20:13:27.229 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T20:13:27.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:13:27.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T20:13:27.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T20:13:27.231 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:13:27.231 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:13:27.232 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T20:13:27.232 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-13T20:13:27.254 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T20:13:27.254 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:13:27.254 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:13:27.254 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19555 2026-02-13T20:13:27.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T20:13:27.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T20:13:27.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-13T20:13:27.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-13T20:13:27.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-13T20:13:27.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-13T20:13:27.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-13T20:13:27.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T20:13:27.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-13T20:13:27.256 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:13:27.256 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:13:27.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:13:27.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:13:27.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:13:27.259 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:13:27.259 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T20:13:27.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T20:13:27.260 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T20:13:27.261 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T20:13:27.261 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T20:13:27.262 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T20:13:27.263 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:13:27.263 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T20:13:27.263 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T20:13:27.263 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:13:27.264 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:13:27.265 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T20:13:27.265 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-13T20:13:27.266 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T20:13:27.266 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:13:27.267 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:13:27.267 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19555 2026-02-13T20:13:27.268 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T20:13:27.268 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T20:13:27.268 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-13T20:13:27.269 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T20:13:27.269 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:13:27.269 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:13:27.269 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.19555 2026-02-13T20:13:27.271 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T20:13:27.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T20:13:27.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T20:13:27.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-13T20:13:27.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_3 td/divergent-priors 2026-02-13T20:13:27.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:630: TEST_divergent_3: local dir=td/divergent-priors 2026-02-13T20:13:27.272 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:632: TEST_divergent_3: file_with_random_data 2026-02-13T20:13:27.272 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-13T20:13:27.273 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-13T20:13:27.274 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:27.274 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.nM2qNSe2Bm bs=512 count=1 2026-02-13T20:13:27.275 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records in 2026-02-13T20:13:27.275 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records out 2026-02-13T20:13:27.275 INFO:tasks.workunit.client.0.trial030.stderr:512 bytes copied, 5.7867e-05 s, 8.8 MB/s 2026-02-13T20:13:27.275 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:27.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:632: TEST_divergent_3: local dummyfile=/tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:27.275 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:634: TEST_divergent_3: file_with_random_data 1000 2026-02-13T20:13:27.275 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=1000 2026-02-13T20:13:27.276 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-13T20:13:27.277 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.NbbgnxSrsZ 2026-02-13T20:13:27.277 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.NbbgnxSrsZ bs=1000 count=1 2026-02-13T20:13:27.278 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records in 2026-02-13T20:13:27.278 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records out 2026-02-13T20:13:27.278 INFO:tasks.workunit.client.0.trial030.stderr:1000 bytes (1.0 kB) copied, 7.7253e-05 s, 12.9 MB/s 2026-02-13T20:13:27.278 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.NbbgnxSrsZ 2026-02-13T20:13:27.278 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:634: TEST_divergent_3: local dummyfile2=/tmp/tmp.NbbgnxSrsZ 2026-02-13T20:13:27.278 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:636: TEST_divergent_3: local num_osds=3 2026-02-13T20:13:27.279 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: expr 3 - 1 2026-02-13T20:13:27.280 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: seq 0 2 2026-02-13T20:13:27.281 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: local 'osds=0 2026-02-13T20:13:27.281 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:13:27.281 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:13:27.281 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:638: TEST_divergent_3: run_mon td/divergent-priors a 2026-02-13T20:13:27.281 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-13T20:13:27.281 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T20:13:27.281 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T20:13:27.281 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T20:13:27.282 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-13T20:13:27.282 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-13T20:13:27.312 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T20:13:27.312 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:13:27.312 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:13:27.312 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:13:27.312 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:13:27.312 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:13:27.312 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:13:27.313 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T20:13:27.350 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T20:13:27.351 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T20:13:27.351 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T20:13:27.351 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T20:13:27.351 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T20:13:27.351 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T20:13:27.352 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T20:13:27.353 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T20:13:27.353 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T20:13:27.353 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:13:27.353 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:13:27.353 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:13:27.353 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-mon.a.asok 2026-02-13T20:13:27.354 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T20:13:27.354 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19555/ceph-mon.a.asok config get fsid 2026-02-13T20:13:27.418 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T20:13:27.418 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T20:13:27.419 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T20:13:27.419 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T20:13:27.419 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T20:13:27.419 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T20:13:27.419 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T20:13:27.419 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T20:13:27.420 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:13:27.420 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:13:27.420 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:13:27.420 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-mon.a.asok 2026-02-13T20:13:27.420 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T20:13:27.421 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19555/ceph-mon.a.asok config get mon_host 2026-02-13T20:13:27.482 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:639: TEST_divergent_3: run_mgr td/divergent-priors x 2026-02-13T20:13:27.482 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-13T20:13:27.482 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T20:13:27.482 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T20:13:27.483 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T20:13:27.483 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-13T20:13:27.483 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T20:13:27.599 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T20:13:27.599 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:13:27.599 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:13:27.599 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:13:27.599 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:13:27.599 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:13:27.600 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:13:27.600 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T20:13:27.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T20:13:27.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-13T20:13:27.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 0 2026-02-13T20:13:27.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T20:13:27.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:13:27.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T20:13:27.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:13:27.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-13T20:13:27.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:13:27.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:13:27.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:13:27.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:13:27.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-13T20:13:27.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-13T20:13:27.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:13:27.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:13:27.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:13:27.622 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:13:27.622 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:13:27.622 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:13:27.622 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:13:27.622 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:13:27.622 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:13:27.622 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:13:27.622 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:13:27.622 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:13:27.622 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:13:27.622 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:13:27.622 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:13:27.622 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:13:27.622 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:13:27.622 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:13:27.622 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:13:27.622 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:13:27.622 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:13:27.622 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:13:27.623 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-13T20:13:27.624 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:13:27.625 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b6e085ae-f1ef-46b2-bb98-365b92356624 2026-02-13T20:13:27.625 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 b6e085ae-f1ef-46b2-bb98-365b92356624' 2026-02-13T20:13:27.625 INFO:tasks.workunit.client.0.trial030.stdout:add osd0 b6e085ae-f1ef-46b2-bb98-365b92356624 2026-02-13T20:13:27.625 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:13:27.639 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDnhY9p5VAbJhAA1D5GqlQ60/3SGWeMdw0VeQ== 2026-02-13T20:13:27.639 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDnhY9p5VAbJhAA1D5GqlQ60/3SGWeMdw0VeQ=="}' 2026-02-13T20:13:27.639 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b6e085ae-f1ef-46b2-bb98-365b92356624 -i td/divergent-priors/0/new.json 2026-02-13T20:13:27.750 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:13:27.758 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-13T20:13:27.759 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDnhY9p5VAbJhAA1D5GqlQ60/3SGWeMdw0VeQ== --osd-uuid b6e085ae-f1ef-46b2-bb98-365b92356624 2026-02-13T20:13:27.779 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:27.776+0000 7f9488477a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:13:27.780 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:27.780+0000 7f9488477a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:13:27.781 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:27.780+0000 7f9488477a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:13:27.782 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:27.780+0000 7f9488477a40 -1 bdev(0x562d764c2400 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-13T20:13:27.782 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:27.780+0000 7f9488477a40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-13T20:13:28.483 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-13T20:13:28.483 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:13:28.484 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T20:13:28.484 INFO:tasks.workunit.client.0.trial030.stdout:adding osd0 key to auth repository 2026-02-13T20:13:28.484 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:13:28.614 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-13T20:13:28.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T20:13:28.616 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:13:28.616 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:13:28.616 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:13:28.616 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:13:28.646 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:28.644+0000 7efcc517da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:13:28.648 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:28.648+0000 7efcc517da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:13:28.649 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:28.648+0000 7efcc517da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:13:28.728 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T20:13:28.728 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:13:28.728 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T20:13:28.729 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:13:28.729 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:13:28.729 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:13:28.729 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:13:28.730 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:13:28.730 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:13:28.731 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:13:28.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:13:29.013 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:29.012+0000 7efcc517da40 -1 Falling back to public interface 2026-02-13T20:13:29.842 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:13:29.843 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:13:29.844 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:13:29.844 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:13:29.844 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:13:29.844 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:13:29.950 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:13:30.057 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:30.056+0000 7efcc517da40 -1 osd.0 0 log_to_monitors true 2026-02-13T20:13:30.951 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:13:30.952 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:13:30.952 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:13:30.953 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T20:13:30.953 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:13:30.953 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:13:31.170 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3756332819,v1:127.0.0.1:6801/3756332819] [v2:127.0.0.1:6802/3756332819,v1:127.0.0.1:6803/3756332819] exists,up b6e085ae-f1ef-46b2-bb98-365b92356624 2026-02-13T20:13:31.175 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:13:31.175 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:13:31.175 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:13:31.175 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-13T20:13:31.175 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 1 2026-02-13T20:13:31.175 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T20:13:31.175 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:13:31.175 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T20:13:31.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:13:31.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-13T20:13:31.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:13:31.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:13:31.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:13:31.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:13:31.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T20:13:31.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T20:13:31.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:13:31.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:13:31.177 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:13:31.177 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:13:31.177 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:13:31.177 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:13:31.177 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:13:31.177 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:13:31.177 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:13:31.177 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:13:31.177 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:13:31.177 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:13:31.177 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:13:31.178 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:13:31.178 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:13:31.178 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:13:31.178 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:13:31.178 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:13:31.178 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:13:31.178 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:13:31.178 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:13:31.178 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:13:31.178 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-13T20:13:31.178 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:13:31.179 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=58e5ae01-f34d-4563-8340-e58b1e0c4c9c 2026-02-13T20:13:31.179 INFO:tasks.workunit.client.0.trial030.stdout:add osd1 58e5ae01-f34d-4563-8340-e58b1e0c4c9c 2026-02-13T20:13:31.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 58e5ae01-f34d-4563-8340-e58b1e0c4c9c' 2026-02-13T20:13:31.180 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:13:31.188 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDrhY9p6cMuCxAAsyazPgGVbuj99NYupuwZfA== 2026-02-13T20:13:31.188 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDrhY9p6cMuCxAAsyazPgGVbuj99NYupuwZfA=="}' 2026-02-13T20:13:31.188 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 58e5ae01-f34d-4563-8340-e58b1e0c4c9c -i td/divergent-priors/1/new.json 2026-02-13T20:13:31.416 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:13:31.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-13T20:13:31.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDrhY9p6cMuCxAAsyazPgGVbuj99NYupuwZfA== --osd-uuid 58e5ae01-f34d-4563-8340-e58b1e0c4c9c 2026-02-13T20:13:31.446 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:31.444+0000 7fe3659c7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:13:31.447 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:31.444+0000 7fe3659c7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:13:31.448 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:31.448+0000 7fe3659c7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:13:31.449 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:31.448+0000 7fe3659c7a40 -1 bdev(0x56102104e400 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-13T20:13:31.449 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:31.448+0000 7fe3659c7a40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-13T20:13:32.066 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-13T20:13:32.066 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:13:32.067 INFO:tasks.workunit.client.0.trial030.stdout:adding osd1 key to auth repository 2026-02-13T20:13:32.067 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T20:13:32.067 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:13:32.369 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-13T20:13:32.370 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T20:13:32.370 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:13:32.370 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:13:32.370 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:13:32.370 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:13:32.398 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:32.396+0000 7f2d8418fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:13:32.400 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:32.400+0000 7f2d8418fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:13:32.402 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:32.400+0000 7f2d8418fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:13:32.581 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T20:13:32.581 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:13:32.581 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T20:13:32.581 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:13:32.582 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:13:32.582 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:13:32.582 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:13:32.583 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:13:32.583 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:13:32.583 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:13:32.749 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:32.748+0000 7f2d8418fa40 -1 Falling back to public interface 2026-02-13T20:13:32.797 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:13:33.354 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:33.352+0000 7f2d8418fa40 -1 osd.1 0 log_to_monitors true 2026-02-13T20:13:33.798 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:13:33.799 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:13:33.799 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:13:33.800 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:13:33.800 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:13:33.800 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:13:34.023 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3416176909,v1:127.0.0.1:6811/3416176909] [v2:127.0.0.1:6812/3416176909,v1:127.0.0.1:6813/3416176909] exists,up 58e5ae01-f34d-4563-8340-e58b1e0c4c9c 2026-02-13T20:13:34.027 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:13:34.028 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:13:34.028 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:13:34.028 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-13T20:13:34.028 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 2 2026-02-13T20:13:34.028 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T20:13:34.028 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:13:34.028 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T20:13:34.028 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:13:34.028 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-13T20:13:34.028 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:13:34.029 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:13:34.029 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:13:34.029 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:13:34.029 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-13T20:13:34.029 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-13T20:13:34.029 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:13:34.029 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:13:34.029 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:13:34.029 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:13:34.029 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:13:34.029 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:13:34.029 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:13:34.030 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:13:34.030 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:13:34.030 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:13:34.030 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:13:34.030 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:13:34.030 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:13:34.030 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:13:34.030 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:13:34.030 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:13:34.030 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:13:34.030 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:13:34.030 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:13:34.031 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:13:34.031 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:13:34.031 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:13:34.031 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-13T20:13:34.031 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:13:34.032 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d77b547d-75d9-49e5-86d4-8ccbd530ae28 2026-02-13T20:13:34.032 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 d77b547d-75d9-49e5-86d4-8ccbd530ae28' 2026-02-13T20:13:34.032 INFO:tasks.workunit.client.0.trial030.stdout:add osd2 d77b547d-75d9-49e5-86d4-8ccbd530ae28 2026-02-13T20:13:34.032 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:13:34.043 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDuhY9pQsSWAhAAcK32JzDyrOyUNiju4nPZpQ== 2026-02-13T20:13:34.043 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDuhY9pQsSWAhAAcK32JzDyrOyUNiju4nPZpQ=="}' 2026-02-13T20:13:34.043 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d77b547d-75d9-49e5-86d4-8ccbd530ae28 -i td/divergent-priors/2/new.json 2026-02-13T20:13:34.274 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:13:34.283 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-13T20:13:34.284 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDuhY9pQsSWAhAAcK32JzDyrOyUNiju4nPZpQ== --osd-uuid d77b547d-75d9-49e5-86d4-8ccbd530ae28 2026-02-13T20:13:34.305 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:34.304+0000 7fe566d98a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:13:34.306 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:34.304+0000 7fe566d98a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:13:34.307 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:34.304+0000 7fe566d98a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:13:34.308 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:34.308+0000 7fe566d98a40 -1 bdev(0x562468f68400 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-13T20:13:34.308 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:34.308+0000 7fe566d98a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-13T20:13:34.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-13T20:13:34.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:13:34.915 INFO:tasks.workunit.client.0.trial030.stdout:adding osd2 key to auth repository 2026-02-13T20:13:34.916 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T20:13:34.916 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:13:35.219 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-13T20:13:35.220 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T20:13:35.221 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:13:35.221 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:13:35.221 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:13:35.221 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:13:35.250 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:35.248+0000 7f5db0f10a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:13:35.251 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:35.248+0000 7f5db0f10a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:13:35.252 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:35.252+0000 7f5db0f10a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:13:35.439 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T20:13:35.439 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:13:35.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T20:13:35.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:13:35.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:13:35.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:13:35.440 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:13:35.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:13:35.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:13:35.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:13:35.629 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:35.628+0000 7f5db0f10a40 -1 Falling back to public interface 2026-02-13T20:13:35.659 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:13:36.257 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:13:36.256+0000 7f5db0f10a40 -1 osd.2 0 log_to_monitors true 2026-02-13T20:13:36.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:13:36.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:13:36.661 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:13:36.662 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:13:36.662 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:13:36.662 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:13:36.871 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:13:37.873 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:13:37.873 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:13:37.873 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T20:13:37.874 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:13:37.874 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:13:37.875 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:13:38.081 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/668485376,v1:127.0.0.1:6819/668485376] [v2:127.0.0.1:6820/668485376,v1:127.0.0.1:6821/668485376] exists,up d77b547d-75d9-49e5-86d4-8ccbd530ae28 2026-02-13T20:13:38.082 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:13:38.082 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:13:38.082 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:13:38.082 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:645: TEST_divergent_3: ceph osd set noout 2026-02-13T20:13:38.389 INFO:tasks.workunit.client.0.trial030.stderr:noout is set 2026-02-13T20:13:38.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:646: TEST_divergent_3: ceph osd set noin 2026-02-13T20:13:38.693 INFO:tasks.workunit.client.0.trial030.stderr:noin is set 2026-02-13T20:13:38.704 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:647: TEST_divergent_3: ceph osd set nodown 2026-02-13T20:13:38.998 INFO:tasks.workunit.client.0.trial030.stderr:nodown is set 2026-02-13T20:13:39.011 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:648: TEST_divergent_3: create_pool test 1 1 2026-02-13T20:13:39.011 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-13T20:13:39.254 INFO:tasks.workunit.client.0.trial030.stderr:pool 'test' already exists 2026-02-13T20:13:39.263 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T20:13:40.265 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:649: TEST_divergent_3: ceph osd pool set test size 3 2026-02-13T20:13:40.537 INFO:tasks.workunit.client.0.trial030.stderr:set pool 1 size to 3 2026-02-13T20:13:40.547 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:650: TEST_divergent_3: ceph osd pool set test min_size 2 2026-02-13T20:13:40.844 INFO:tasks.workunit.client.0.trial030.stderr:set pool 1 min_size to 2 2026-02-13T20:13:40.855 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:653: TEST_divergent_3: ceph osd pool set test pg_autoscale_mode on 2026-02-13T20:13:41.148 INFO:tasks.workunit.client.0.trial030.stderr:set pool 1 pg_autoscale_mode to on 2026-02-13T20:13:41.158 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:655: TEST_divergent_3: divergent=-1 2026-02-13T20:13:41.158 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:656: TEST_divergent_3: date +%s 2026-02-13T20:13:41.159 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:656: TEST_divergent_3: start_time=1771013621 2026-02-13T20:13:41.159 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:657: TEST_divergent_3: max_duration=300 2026-02-13T20:13:41.159 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:659: TEST_divergent_3: '[' -1 -le -1 ']' 2026-02-13T20:13:41.159 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:661: TEST_divergent_3: flush_pg_stats 2026-02-13T20:13:41.159 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T20:13:41.159 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T20:13:41.375 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T20:13:41.375 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:13:41.375 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:13:41.375 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T20:13:41.375 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:13:41.375 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-13T20:13:41.461 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836486 2026-02-13T20:13:41.461 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836486 2026-02-13T20:13:41.461 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486' 2026-02-13T20:13:41.461 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:13:41.461 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-13T20:13:41.543 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-13T20:13:41.543 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-13T20:13:41.544 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-42949672964' 2026-02-13T20:13:41.544 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:13:41.544 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-13T20:13:41.628 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542148 2026-02-13T20:13:41.629 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542148 2026-02-13T20:13:41.629 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-42949672964 2-60129542148' 2026-02-13T20:13:41.629 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:13:41.629 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836486 2026-02-13T20:13:41.629 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:13:41.629 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-13T20:13:41.630 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836486 2026-02-13T20:13:41.631 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:13:41.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836486 2026-02-13T20:13:41.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836486' 2026-02-13T20:13:41.633 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836486 2026-02-13T20:13:41.633 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:13:41.846 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836486 2026-02-13T20:13:41.846 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:13:42.847 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T20:13:42.848 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:13:43.059 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836486 2026-02-13T20:13:43.059 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:13:43.059 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-13T20:13:43.059 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:13:43.060 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-13T20:13:43.061 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-13T20:13:43.061 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:13:43.062 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-13T20:13:43.062 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-13T20:13:43.063 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 42949672964 2026-02-13T20:13:43.063 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T20:13:43.280 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-13T20:13:43.280 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:13:43.281 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542148 2026-02-13T20:13:43.281 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:13:43.282 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-13T20:13:43.282 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542148 2026-02-13T20:13:43.283 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:13:43.284 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542148 2026-02-13T20:13:43.284 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542148' 2026-02-13T20:13:43.284 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 60129542148 2026-02-13T20:13:43.285 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:13:43.509 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542148 2026-02-13T20:13:43.509 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:662: TEST_divergent_3: wait_for_clean 2026-02-13T20:13:43.509 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T20:13:43.509 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T20:13:43.509 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T20:13:43.510 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T20:13:43.511 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T20:13:43.511 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T20:13:43.511 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T20:13:43.511 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T20:13:43.511 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T20:13:43.619 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T20:13:43.619 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T20:13:43.619 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T20:13:43.619 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T20:13:43.619 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T20:13:43.620 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T20:13:43.838 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T20:13:43.838 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:13:43.838 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:13:43.838 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T20:13:43.838 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:13:43.838 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-13T20:13:43.922 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836488 2026-02-13T20:13:43.922 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836488 2026-02-13T20:13:43.922 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488' 2026-02-13T20:13:43.922 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:13:43.922 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-13T20:13:44.004 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672966 2026-02-13T20:13:44.004 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672966 2026-02-13T20:13:44.004 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-42949672966' 2026-02-13T20:13:44.004 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:13:44.004 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-13T20:13:44.088 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542151 2026-02-13T20:13:44.088 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542151 2026-02-13T20:13:44.088 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-42949672966 2-60129542151' 2026-02-13T20:13:44.088 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:13:44.089 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836488 2026-02-13T20:13:44.089 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:13:44.090 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-13T20:13:44.091 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836488 2026-02-13T20:13:44.091 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:13:44.093 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836488 2026-02-13T20:13:44.093 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836488 2026-02-13T20:13:44.094 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2026-02-13T20:13:44.094 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:13:44.304 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836488 2026-02-13T20:13:44.304 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:13:45.305 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T20:13:45.305 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:13:45.528 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836488 2026-02-13T20:13:45.529 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:13:46.530 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-13T20:13:46.530 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:13:46.746 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836488 2026-02-13T20:13:46.746 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:13:46.747 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672966 2026-02-13T20:13:46.747 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:13:46.748 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-13T20:13:46.749 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672966 2026-02-13T20:13:46.749 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:13:46.750 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672966 2026-02-13T20:13:46.751 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 42949672966 2026-02-13T20:13:46.751 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672966' 2026-02-13T20:13:46.751 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T20:13:46.978 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672967 -lt 42949672966 2026-02-13T20:13:46.978 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:13:46.979 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542151 2026-02-13T20:13:46.979 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:13:46.980 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-13T20:13:46.981 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542151 2026-02-13T20:13:46.981 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:13:46.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542151 2026-02-13T20:13:46.983 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 60129542151 2026-02-13T20:13:46.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542151' 2026-02-13T20:13:46.983 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:13:47.210 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542151 -lt 60129542151 2026-02-13T20:13:47.211 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T20:13:47.211 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:13:47.212 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:13:47.507 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T20:13:47.507 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:13:47.507 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:13:47.507 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:13:47.507 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:13:47.507 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:13:47.508 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:13:47.508 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:13:47.726 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-13T20:13:47.727 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:13:47.727 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:13:47.727 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:13:48.024 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-13T20:13:48.024 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T20:13:48.024 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T20:13:48.025 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: ceph pg dump pgs --format=json 2026-02-13T20:13:48.025 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: jq '.pg_stats[0].up_primary' 2026-02-13T20:13:48.231 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:13:48.241 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: divergent=1 2026-02-13T20:13:48.241 INFO:tasks.workunit.client.0.trial030.stdout:primary and soon to be divergent is 1 2026-02-13T20:13:48.242 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:666: TEST_divergent_3: echo 'primary and soon to be divergent is 1' 2026-02-13T20:13:48.242 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:667: TEST_divergent_3: ceph pg dump pgs 2026-02-13T20:13:48.444 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:13:48.444 INFO:tasks.workunit.client.0.trial030.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T20:13:40.285118+0000 0'0 29:24 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 periodic scrub scheduled @ 2026-02-14T22:50:39.017561+0000 0 0 2026-02-13T20:13:48.444 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:13:48.444 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:13:48.444 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:13:48.453 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:669: TEST_divergent_3: date +%s 2026-02-13T20:13:48.453 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:669: TEST_divergent_3: current_time=1771013628 2026-02-13T20:13:48.454 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:670: TEST_divergent_3: expr 1771013628 - 1771013621 2026-02-13T20:13:48.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:670: TEST_divergent_3: elapsed_time=7 2026-02-13T20:13:48.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: '[' 7 -gt 300 ']' 2026-02-13T20:13:48.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:659: TEST_divergent_3: '[' 1 -le -1 ']' 2026-02-13T20:13:48.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:677: TEST_divergent_3: local non_divergent= 2026-02-13T20:13:48.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-13T20:13:48.457 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 0 = 1 ']' 2026-02-13T20:13:48.457 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:683: TEST_divergent_3: non_divergent=' 0' 2026-02-13T20:13:48.457 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-13T20:13:48.457 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 1 = 1 ']' 2026-02-13T20:13:48.457 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:681: TEST_divergent_3: continue 2026-02-13T20:13:48.457 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-13T20:13:48.457 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 2 = 1 ']' 2026-02-13T20:13:48.457 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:683: TEST_divergent_3: non_divergent=' 0 2' 2026-02-13T20:13:48.457 INFO:tasks.workunit.client.0.trial030.stdout:writing initial objects 2026-02-13T20:13:48.458 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: echo 'writing initial objects' 2026-02-13T20:13:48.458 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: seq 1 100 2026-02-13T20:13:48.458 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:48.458 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_1 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:48.480 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:48.480 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_2 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:48.508 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:48.509 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_3 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:48.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:48.536 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_4 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:48.561 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:48.561 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_5 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:48.589 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:48.590 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_6 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:48.618 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:48.618 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_7 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:48.647 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:48.647 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_8 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:48.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:48.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_9 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:48.696 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:48.696 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_10 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:48.718 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:48.718 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_11 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:48.746 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:48.746 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_12 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:48.775 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:48.775 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_13 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:48.804 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:48.804 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_14 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:48.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:48.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_15 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:48.862 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:48.862 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_16 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:48.890 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:48.890 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_17 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:48.919 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:48.919 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_18 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:48.939 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:48.939 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_19 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:48.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:48.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_20 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:48.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:48.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_21 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.023 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.023 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_22 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.050 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.050 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_23 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.078 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.079 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_24 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.106 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.106 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_25 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.134 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.135 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_26 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.163 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.163 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_27 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.191 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.191 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_28 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.221 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.221 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_29 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.249 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.249 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_30 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.278 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.278 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_31 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.306 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.306 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_32 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.334 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.334 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_33 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.362 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.363 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_34 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_35 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.412 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.412 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_36 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.439 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_37 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.467 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.468 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_38 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.494 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.494 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_39 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.522 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.522 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_40 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.549 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.550 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_41 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.578 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.578 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_42 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.598 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.599 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_43 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.627 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.627 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_44 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.647 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.647 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_45 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.669 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.669 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_46 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.697 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.697 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_47 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.718 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.718 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_48 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.746 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.747 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_49 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.775 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.775 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_50 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.804 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.804 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_51 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.833 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.833 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_52 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.861 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.861 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_53 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_54 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.917 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.917 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_55 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.938 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.938 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_56 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.958 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.958 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_57 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:49.987 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:49.987 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_58 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.007 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.007 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_59 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_60 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_61 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.092 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.092 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_62 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.122 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.122 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_63 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.150 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.150 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_64 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.171 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.171 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_65 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.200 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.200 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_66 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.227 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.227 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_67 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_68 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.286 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_69 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.314 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.314 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_70 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.343 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.343 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_71 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.371 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_72 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.401 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.401 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_73 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.429 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_74 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.458 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.458 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_75 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.486 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.486 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_76 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.506 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.506 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_77 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_78 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.561 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.562 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_79 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.589 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.589 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_80 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.617 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.617 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_81 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.645 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.646 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_82 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.673 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.673 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_83 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.701 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.701 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_84 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.729 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.729 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_85 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.757 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.757 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_86 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.786 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_87 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.814 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.814 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_88 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.842 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.842 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_89 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.870 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.870 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_90 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.898 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.898 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_91 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.925 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.925 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_92 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.953 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.953 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_93 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:50.981 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:50.981 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_94 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:51.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:51.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_95 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:51.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:51.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_96 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:51.065 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:51.065 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_97 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:51.094 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:51.094 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_98 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:51.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:51.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_99 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:51.150 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T20:13:51.150 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_100 /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:13:51.178 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:693: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-13T20:13:51.178 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:693: TEST_divergent_3: wait_for_clean 2026-02-13T20:13:51.178 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T20:13:51.178 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T20:13:51.178 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T20:13:51.179 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-13T20:13:51.180 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T20:13:51.180 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T20:13:51.180 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T20:13:51.180 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T20:13:51.180 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T20:13:51.251 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-13T20:13:51.251 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T20:13:51.251 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T20:13:51.251 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T20:13:51.252 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T20:13:51.252 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T20:13:51.465 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T20:13:51.466 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:13:51.466 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:13:51.466 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T20:13:51.466 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:13:51.466 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-13T20:13:51.549 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836492 2026-02-13T20:13:51.550 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836492 2026-02-13T20:13:51.550 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492' 2026-02-13T20:13:51.550 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:13:51.550 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-13T20:13:51.634 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672970 2026-02-13T20:13:51.634 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672970 2026-02-13T20:13:51.634 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-42949672970' 2026-02-13T20:13:51.634 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:13:51.635 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-13T20:13:51.716 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542154 2026-02-13T20:13:51.716 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542154 2026-02-13T20:13:51.716 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-42949672970 2-60129542154' 2026-02-13T20:13:51.716 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:13:51.717 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836492 2026-02-13T20:13:51.717 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:13:51.718 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-13T20:13:51.718 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836492 2026-02-13T20:13:51.719 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:13:51.720 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836492 2026-02-13T20:13:51.720 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-13T20:13:51.720 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836492 2026-02-13T20:13:51.720 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:13:51.942 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836492 -lt 21474836492 2026-02-13T20:13:51.942 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:13:51.943 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672970 2026-02-13T20:13:51.943 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:13:51.944 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-13T20:13:51.944 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672970 2026-02-13T20:13:51.945 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:13:51.946 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672970 2026-02-13T20:13:51.946 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 42949672970 2026-02-13T20:13:51.947 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672970' 2026-02-13T20:13:51.947 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T20:13:52.175 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672970 -lt 42949672970 2026-02-13T20:13:52.175 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:13:52.176 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542154 2026-02-13T20:13:52.176 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:13:52.177 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-13T20:13:52.178 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542154 2026-02-13T20:13:52.178 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:13:52.179 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542154 2026-02-13T20:13:52.179 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 60129542154 2026-02-13T20:13:52.179 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542154' 2026-02-13T20:13:52.180 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:13:52.400 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542154 -lt 60129542154 2026-02-13T20:13:52.401 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T20:13:52.401 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:13:52.401 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:13:52.701 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T20:13:52.701 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:13:52.701 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:13:52.702 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:13:52.702 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:13:52.702 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:13:52.702 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:13:52.702 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:13:52.916 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-13T20:13:52.917 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:13:52.917 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:13:52.917 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:13:53.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-13T20:13:53.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T20:13:53.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T20:13:53.215 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:695: TEST_divergent_3: get_pg test existing_1 2026-02-13T20:13:53.215 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-13T20:13:53.215 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-13T20:13:53.215 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-13T20:13:53.216 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-13T20:13:53.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:695: TEST_divergent_3: local pgid=1.0 2026-02-13T20:13:53.440 INFO:tasks.workunit.client.0.trial030.stdout:blackholing osds 0 2 2026-02-13T20:13:53.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:698: TEST_divergent_3: echo 'blackholing osds 0 2' 2026-02-13T20:13:53.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:699: TEST_divergent_3: ceph pg dump pgs 2026-02-13T20:13:53.643 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:13:53.643 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-13T20:13:40.285118+0000 29'100 29:124 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 periodic scrub scheduled @ 2026-02-14T22:50:39.017561+0000 0 0 2026-02-13T20:13:53.643 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:13:53.643 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:13:53.644 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:13:53.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: for i in $non_divergent 2026-02-13T20:13:53.653 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: get_asok_path osd.0 2026-02-13T20:13:53.653 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T20:13:53.653 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T20:13:53.653 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:13:53.653 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:13:53.653 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:13:53.654 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.0.asok 2026-02-13T20:13:53.654 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: CEPH_ARGS= 2026-02-13T20:13:53.654 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-13T20:13:53.706 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-13T20:13:53.706 INFO:tasks.workunit.client.0.trial030.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-13T20:13:53.707 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-13T20:13:53.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: for i in $non_divergent 2026-02-13T20:13:53.714 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: get_asok_path osd.2 2026-02-13T20:13:53.714 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-13T20:13:53.714 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-13T20:13:53.715 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:13:53.715 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:13:53.715 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:13:53.715 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.2.asok 2026-02-13T20:13:53.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: CEPH_ARGS= 2026-02-13T20:13:53.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-13T20:13:53.773 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-13T20:13:53.773 INFO:tasks.workunit.client.0.trial030.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-13T20:13:53.773 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-13T20:13:53.779 INFO:tasks.workunit.client.0.trial030.stdout:create new divergent objects 2026-02-13T20:13:53.779 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:706: TEST_divergent_3: echo 'create new divergent objects' 2026-02-13T20:13:53.779 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: seq 1 2 2026-02-13T20:13:53.780 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-13T20:13:53.780 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-13T20:13:53.780 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:709: TEST_divergent_3: rados -p test create newobject_1 2026-02-13T20:13:53.780 INFO:tasks.workunit.client.0.trial030.stdout:writing divergent objects 2026-02-13T20:13:53.781 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:712: TEST_divergent_3: echo 'writing divergent objects' 2026-02-13T20:13:53.781 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:709: TEST_divergent_3: rados -p test create newobject_2 2026-02-13T20:13:53.781 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: seq 1 2 2026-02-13T20:13:53.782 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-13T20:13:53.782 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-13T20:13:53.782 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:715: TEST_divergent_3: rados -p test put existing_1 /tmp/tmp.NbbgnxSrsZ 2026-02-13T20:13:53.783 INFO:tasks.workunit.client.0.trial030.stdout:remove divergent objects 2026-02-13T20:13:53.783 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:718: TEST_divergent_3: echo 'remove divergent objects' 2026-02-13T20:13:53.783 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:715: TEST_divergent_3: rados -p test put existing_2 /tmp/tmp.NbbgnxSrsZ 2026-02-13T20:13:53.783 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: seq 1 2 2026-02-13T20:13:53.784 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-13T20:13:53.784 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: expr 1 + 2 2026-02-13T20:13:53.786 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: rmi=3 2026-02-13T20:13:53.786 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-13T20:13:53.786 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:722: TEST_divergent_3: rados -p test rm existing_3 2026-02-13T20:13:53.786 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: expr 2 + 2 2026-02-13T20:13:53.788 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: rmi=4 2026-02-13T20:13:53.788 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:724: TEST_divergent_3: sleep 10 2026-02-13T20:13:53.788 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:722: TEST_divergent_3: rados -p test rm existing_4 2026-02-13T20:14:03.790 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:725: TEST_divergent_3: killall -9 rados 2026-02-13T20:14:03.838 INFO:tasks.workunit.client.0.trial030.stderr:rados: no process found 2026-02-13T20:14:03.838 INFO:tasks.workunit.client.0.trial030.stdout:killing all the osds 2026-02-13T20:14:03.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:728: TEST_divergent_3: echo 'killing all the osds' 2026-02-13T20:14:03.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:729: TEST_divergent_3: ceph pg dump pgs 2026-02-13T20:14:04.046 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:14:04.046 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 active+clean 2026-02-13T20:13:40.285118+0000 29'106 29:130 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 periodic scrub scheduled @ 2026-02-14T22:50:39.017561+0000 0 0 2026-02-13T20:14:04.046 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:14:04.046 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:14:04.046 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:14:04.054 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:730: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd 2026-02-13T20:14:04.056 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:14:04.056 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:14:04.056 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:14:04.056 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:14:04.056 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:14:04.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:14:04.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-13T20:14:04.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.0 2026-02-13T20:14:04.432 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already down. 2026-02-13T20:14:04.442 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-13T20:14:04.442 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.1 2026-02-13T20:14:04.723 INFO:tasks.workunit.client.0.trial030.stderr:osd.1 is already down. 2026-02-13T20:14:04.733 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-13T20:14:04.733 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.2 2026-02-13T20:14:05.015 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already down. 2026-02-13T20:14:05.025 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: for i in $non_divergent 2026-02-13T20:14:05.026 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:737: TEST_divergent_3: ceph osd out osd.0 2026-02-13T20:14:05.304 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already out. 2026-02-13T20:14:05.316 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: for i in $non_divergent 2026-02-13T20:14:05.316 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:737: TEST_divergent_3: ceph osd out osd.2 2026-02-13T20:14:05.589 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already out. 2026-02-13T20:14:05.598 INFO:tasks.workunit.client.0.trial030.stdout:bringing up non_divergent 0 2 2026-02-13T20:14:05.599 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:741: TEST_divergent_3: echo 'bringing up non_divergent 0 2' 2026-02-13T20:14:05.599 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:742: TEST_divergent_3: ceph pg dump pgs 2026-02-13T20:14:05.818 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:14:05.818 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 stale+active+clean 2026-02-13T20:13:40.285118+0000 29'106 29:130 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 periodic scrub scheduled @ 2026-02-14T22:50:39.017561+0000 0 0 2026-02-13T20:14:05.818 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:14:05.818 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:14:05.818 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:14:05.829 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: for i in $non_divergent 2026-02-13T20:14:05.829 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:745: TEST_divergent_3: activate_osd td/divergent-priors 0 2026-02-13T20:14:05.829 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T20:14:05.829 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T20:14:05.830 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-13T20:14:05.830 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T20:14:05.830 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-13T20:14:05.830 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:14:05.830 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:14:05.830 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:14:05.830 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:14:05.830 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-13T20:14:05.830 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-13T20:14:05.830 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T20:14:05.830 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T20:14:05.830 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:14:05.831 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T20:14:05.831 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:14:05.831 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:14:05.831 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:14:05.831 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:14:05.831 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:14:05.831 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:14:05.831 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:14:05.831 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:14:05.831 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:14:05.831 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:14:05.831 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:14:05.832 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:14:05.832 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:14:05.832 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:14:05.832 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T20:14:05.832 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T20:14:05.832 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-13T20:14:05.832 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-13T20:14:05.833 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-13T20:14:05.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:14:05.834 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-13T20:14:05.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-13T20:14:05.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T20:14:05.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T20:14:05.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T20:14:05.857 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:14:05.855+0000 7f5402a71a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:14:05.858 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:14:05.855+0000 7f5402a71a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:14:05.859 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:14:05.855+0000 7f5402a71a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:14:06.051 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-13T20:14:06.051 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:14:06.051 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T20:14:06.051 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:14:06.051 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:14:06.051 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:14:06.051 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:14:06.052 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:14:06.052 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:14:06.052 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:14:06.274 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:14:06.309 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:14:06.307+0000 7f5402a71a40 -1 Falling back to public interface 2026-02-13T20:14:06.905 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:14:06.903+0000 7f5402a71a40 -1 osd.0 29 log_to_monitors true 2026-02-13T20:14:07.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:14:07.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:14:07.275 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:14:07.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:14:07.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:14:07.276 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:14:07.494 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up out weight 0 up_from 36 up_thru 0 down_at 30 last_clean_interval [5,29) [v2:127.0.0.1:6800/1169190239,v1:127.0.0.1:6801/1169190239] [v2:127.0.0.1:6802/1169190239,v1:127.0.0.1:6803/1169190239] exists,up b6e085ae-f1ef-46b2-bb98-365b92356624 2026-02-13T20:14:07.497 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:14:07.497 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:14:07.497 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:14:07.497 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: for i in $non_divergent 2026-02-13T20:14:07.497 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:745: TEST_divergent_3: activate_osd td/divergent-priors 2 2026-02-13T20:14:07.497 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T20:14:07.497 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T20:14:07.497 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T20:14:07.497 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T20:14:07.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-13T20:14:07.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:14:07.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:14:07.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:14:07.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:14:07.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-13T20:14:07.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-13T20:14:07.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T20:14:07.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T20:14:07.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:14:07.498 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T20:14:07.499 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:14:07.499 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:14:07.499 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:14:07.499 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:14:07.499 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:14:07.499 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:14:07.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:14:07.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:14:07.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:14:07.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:14:07.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:14:07.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:14:07.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:14:07.500 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:14:07.500 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T20:14:07.500 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T20:14:07.500 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-13T20:14:07.500 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-13T20:14:07.501 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T20:14:07.501 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:14:07.501 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-13T20:14:07.501 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T20:14:07.502 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T20:14:07.502 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T20:14:07.502 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T20:14:07.519 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:14:07.515+0000 7ffa01001a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:14:07.521 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:14:07.519+0000 7ffa01001a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:14:07.522 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:14:07.519+0000 7ffa01001a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:14:07.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T20:14:07.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:14:07.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T20:14:07.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:14:07.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:14:07.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:14:07.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:14:07.710 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:14:07.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:14:07.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:14:07.901 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:14:07.898+0000 7ffa01001a40 -1 Falling back to public interface 2026-02-13T20:14:07.930 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:14:08.464 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:14:08.462+0000 7ffa01001a40 -1 osd.2 29 log_to_monitors true 2026-02-13T20:14:08.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:14:08.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:14:08.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:14:08.932 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:14:08.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:14:08.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:14:09.148 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up out weight 0 up_from 38 up_thru 0 down_at 32 last_clean_interval [14,29) [v2:127.0.0.1:6810/2057545651,v1:127.0.0.1:6811/2057545651] [v2:127.0.0.1:6812/2057545651,v1:127.0.0.1:6813/2057545651] exists,up d77b547d-75d9-49e5-86d4-8ccbd530ae28 2026-02-13T20:14:09.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:14:09.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:14:09.150 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:14:09.150 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: for i in $non_divergent 2026-02-13T20:14:09.150 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:749: TEST_divergent_3: ceph osd in osd.0 2026-02-13T20:14:09.399 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already in. 2026-02-13T20:14:09.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: for i in $non_divergent 2026-02-13T20:14:09.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:749: TEST_divergent_3: ceph osd in osd.2 2026-02-13T20:14:09.650 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already in. 2026-02-13T20:14:09.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:752: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-13T20:14:09.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:752: TEST_divergent_3: wait_for_clean 2026-02-13T20:14:09.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T20:14:09.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T20:14:09.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T20:14:09.660 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-13T20:14:09.661 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T20:14:09.661 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T20:14:09.661 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T20:14:09.661 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T20:14:09.661 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T20:14:09.730 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-13T20:14:09.730 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T20:14:09.730 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T20:14:09.731 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T20:14:09.731 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T20:14:09.731 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T20:14:09.951 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T20:14:09.951 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:14:09.951 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:14:09.951 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T20:14:09.951 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:14:09.951 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-13T20:14:10.035 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822659 2026-02-13T20:14:10.035 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822659 2026-02-13T20:14:10.035 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-154618822659' 2026-02-13T20:14:10.036 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:14:10.036 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-13T20:14:10.098 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-13T20:14:10.099 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-13T20:14:10.099 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-13T20:14:10.099 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-13T20:14:10.099 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:14:10.099 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-13T20:14:10.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757251 2026-02-13T20:14:10.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757251 2026-02-13T20:14:10.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-154618822659 2-163208757251' 2026-02-13T20:14:10.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:14:10.181 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-154618822659 2026-02-13T20:14:10.181 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:14:10.182 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-13T20:14:10.182 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-154618822659 2026-02-13T20:14:10.183 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:14:10.184 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822659 2026-02-13T20:14:10.184 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 154618822659 2026-02-13T20:14:10.185 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 154618822659' 2026-02-13T20:14:10.185 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:14:10.396 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 154618822659 2026-02-13T20:14:10.397 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:14:11.398 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T20:14:11.398 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:14:11.620 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 154618822659 2026-02-13T20:14:11.620 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:14:12.622 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-13T20:14:12.622 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:14:12.837 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822659 -lt 154618822659 2026-02-13T20:14:12.838 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:14:12.838 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-163208757251 2026-02-13T20:14:12.838 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:14:12.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-13T20:14:12.840 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-163208757251 2026-02-13T20:14:12.840 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:14:12.842 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757251 2026-02-13T20:14:12.842 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 163208757251 2026-02-13T20:14:12.842 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 163208757251' 2026-02-13T20:14:12.843 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:14:13.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757251 -lt 163208757251 2026-02-13T20:14:13.063 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T20:14:13.063 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:14:13.064 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:14:13.362 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T20:14:13.362 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:14:13.362 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:14:13.362 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:14:13.362 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:14:13.362 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:14:13.363 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:14:13.363 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:14:13.583 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:14:13.583 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:14:13.583 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:14:13.583 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:14:13.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:14:13.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-13T20:14:13.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-13T20:14:13.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-13T20:14:13.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:14:13.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-13T20:14:13.978 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:14:13.978 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:14:13.979 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:14:13.980 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:14:13.980 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:14:13.980 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:14:13.980 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:14:13.980 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:14:14.192 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:14:14.192 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:14:14.192 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:14:14.192 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:14:14.480 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:14:14.480 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:14:14.480 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:14:14.480 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:14:14.480 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:14:14.480 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:14:14.480 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:14:14.480 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:14:14.480 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:14:14.772 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:14:14.772 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:14:14.772 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-13T20:14:14.772 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:14:14.772 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-13T20:14:14.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:14:14.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:14:14.975 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:14:14.975 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:14:14.975 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:14:14.975 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:14:14.975 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:14:14.975 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:14:15.192 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:14:15.193 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:14:15.193 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:14:15.193 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:14:15.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:14:15.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:14:15.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:14:15.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:14:15.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:14:15.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:14:15.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:14:15.476 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:14:15.476 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:14:15.771 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:14:15.771 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:14:15.772 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-13T20:14:15.772 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:14:15.772 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-13T20:14:16.172 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:14:16.172 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:14:16.172 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:14:16.173 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:14:16.173 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:14:16.173 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:14:16.173 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:14:16.173 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:14:16.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:14:16.395 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:14:16.396 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:14:16.396 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:14:16.690 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:14:16.690 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:14:16.691 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:14:16.691 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:14:16.691 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:14:16.691 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:14:16.691 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:14:16.691 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:14:16.691 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:14:16.986 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:14:16.986 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:14:16.986 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-13T20:14:16.986 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:14:16.986 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-13T20:14:17.787 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:14:17.788 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:14:17.789 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:14:17.789 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:14:17.789 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:14:17.789 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:14:17.789 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:14:17.789 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:14:18.012 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:14:18.012 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:14:18.013 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:14:18.013 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:14:18.305 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:14:18.306 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:14:18.306 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:14:18.306 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:14:18.306 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:14:18.306 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:14:18.306 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:14:18.306 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:14:18.306 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:14:18.598 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:14:18.598 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:14:18.598 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-13T20:14:18.598 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:14:18.598 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-13T20:14:20.199 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:14:20.199 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:14:20.200 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:14:20.200 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:14:20.200 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:14:20.200 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:14:20.201 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:14:20.201 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:14:20.417 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:14:20.417 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:14:20.418 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:14:20.418 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:14:20.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:14:20.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:14:20.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:14:20.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:14:20.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:14:20.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:14:20.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:14:20.709 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:14:20.709 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:14:20.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:14:20.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:14:20.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-13T20:14:20.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:14:20.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-13T20:14:24.196 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:14:24.196 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:14:24.197 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:14:24.197 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:14:24.197 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:14:24.197 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:14:24.197 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:14:24.198 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:14:24.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:14:24.409 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:14:24.410 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:14:24.410 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:14:24.689 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:14:24.690 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:14:24.690 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:14:24.690 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:14:24.690 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:14:24.690 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:14:24.690 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:14:24.690 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:14:24.690 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:14:24.966 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:14:24.967 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:14:24.967 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-13T20:14:24.967 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:14:24.967 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-13T20:14:31.367 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:14:31.367 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:14:31.368 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:14:31.368 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:14:31.369 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:14:31.369 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:14:31.369 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:14:31.369 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:14:31.584 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:14:31.585 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:14:31.585 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:14:31.586 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:14:31.876 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:14:31.876 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:14:31.876 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:14:31.876 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:14:31.876 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:14:31.876 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:14:31.876 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:14:31.876 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:14:31.877 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:14:32.171 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:14:32.171 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:14:32.171 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-13T20:14:32.171 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:14:32.171 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-13T20:14:39.473 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:14:39.473 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:14:39.474 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:14:39.474 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:14:39.475 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:14:39.475 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:14:39.475 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:14:39.475 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:14:39.693 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:14:39.694 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:14:39.694 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:14:39.694 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:14:39.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-13T20:14:39.984 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:14:39.984 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:14:39.984 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:14:39.984 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:14:39.984 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:14:39.984 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:14:39.985 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:14:39.985 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:14:40.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:14:40.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:14:40.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-13T20:14:40.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-13T20:14:40.553 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-13T20:14:40.553 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_fingerprint": "5040d525-f45b-4ab5-a639-5eac6ba9f32e", 2026-02-13T20:14:40.553 INFO:tasks.workunit.client.0.trial030.stdout: "version": "20.3.0-5230-gafefaa40", 2026-02-13T20:14:40.553 INFO:tasks.workunit.client.0.trial030.stdout: "commit": "afefaa40503a4bf024e96f97dd7f852b75f00ad6", 2026-02-13T20:14:40.553 INFO:tasks.workunit.client.0.trial030.stdout: "timestamp": "2026-02-13T20:14:40.552745+0000", 2026-02-13T20:14:40.554 INFO:tasks.workunit.client.0.trial030.stdout: "tag": "", 2026-02-13T20:14:40.554 INFO:tasks.workunit.client.0.trial030.stdout: "health": { 2026-02-13T20:14:40.554 INFO:tasks.workunit.client.0.trial030.stdout: "status": "HEALTH_WARN", 2026-02-13T20:14:40.554 INFO:tasks.workunit.client.0.trial030.stdout: "checks": { 2026-02-13T20:14:40.554 INFO:tasks.workunit.client.0.trial030.stdout: "OSDMAP_FLAGS": { 2026-02-13T20:14:40.554 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-13T20:14:40.554 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-13T20:14:40.554 INFO:tasks.workunit.client.0.trial030.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-13T20:14:40.554 INFO:tasks.workunit.client.0.trial030.stdout: "count": 17 2026-02-13T20:14:40.554 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.554 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [], 2026-02-13T20:14:40.555 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-13T20:14:40.555 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.555 INFO:tasks.workunit.client.0.trial030.stdout: "OSD_DOWN": { 2026-02-13T20:14:40.555 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-13T20:14:40.555 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-13T20:14:40.555 INFO:tasks.workunit.client.0.trial030.stdout: "message": "1 osds down", 2026-02-13T20:14:40.555 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-13T20:14:40.555 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.555 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-13T20:14:40.555 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.555 INFO:tasks.workunit.client.0.trial030.stdout: "message": "osd.1 (root=default,host=trial030) is down" 2026-02-13T20:14:40.555 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.556 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:14:40.556 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-13T20:14:40.556 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.556 INFO:tasks.workunit.client.0.trial030.stdout: "PG_DEGRADED": { 2026-02-13T20:14:40.556 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-13T20:14:40.556 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-13T20:14:40.556 INFO:tasks.workunit.client.0.trial030.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2026-02-13T20:14:40.556 INFO:tasks.workunit.client.0.trial030.stdout: "count": 32 2026-02-13T20:14:40.556 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.556 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-13T20:14:40.556 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.556 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.0 is active+undersized+degraded+wait, acting [0,2]" 2026-02-13T20:14:40.557 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.557 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.557 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.557 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.557 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.557 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.557 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.557 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.557 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.557 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.557 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.557 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.558 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.558 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.558 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.558 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.558 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.558 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.558 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.558 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.558 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.558 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.558 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.558 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.558 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.559 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.559 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.559 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.559 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.559 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.559 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.559 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.559 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.559 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.559 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.559 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.559 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.560 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.560 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.560 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.560 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.560 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.560 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.560 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.560 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.560 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.560 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.560 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.560 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.560 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.561 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.561 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.561 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.561 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.561 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.561 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.561 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.561 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.561 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.561 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.561 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.561 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.561 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.562 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.562 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.562 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.562 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.562 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.562 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.562 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.562 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.562 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.562 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.562 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.563 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.563 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.563 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.563 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.563 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.564 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.564 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.564 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.564 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.564 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.564 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.564 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.565 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.565 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.565 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.565 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.565 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.565 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.566 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2026-02-13T20:14:40.566 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.566 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:14:40.566 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-13T20:14:40.566 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.566 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.566 INFO:tasks.workunit.client.0.trial030.stdout: "mutes": [] 2026-02-13T20:14:40.567 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.567 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_first_committed": 1, 2026-02-13T20:14:40.567 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_last_committed": 1, 2026-02-13T20:14:40.567 INFO:tasks.workunit.client.0.trial030.stdout: "monmap": { 2026-02-13T20:14:40.567 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-13T20:14:40.567 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "76a1de22-3326-43d1-82f4-48cedec81b31", 2026-02-13T20:14:40.567 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-13T20:13:27.304842Z", 2026-02-13T20:14:40.568 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-13T20:13:27.304842Z", 2026-02-13T20:14:40.568 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release": 20, 2026-02-13T20:14:40.568 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:14:40.568 INFO:tasks.workunit.client.0.trial030.stdout: "election_strategy": 1, 2026-02-13T20:14:40.568 INFO:tasks.workunit.client.0.trial030.stdout: "disallowed_leaders": "", 2026-02-13T20:14:40.568 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": false, 2026-02-13T20:14:40.568 INFO:tasks.workunit.client.0.trial030.stdout: "tiebreaker_mon": "", 2026-02-13T20:14:40.569 INFO:tasks.workunit.client.0.trial030.stdout: "removed_ranks": "", 2026-02-13T20:14:40.569 INFO:tasks.workunit.client.0.trial030.stdout: "features": { 2026-02-13T20:14:40.569 INFO:tasks.workunit.client.0.trial030.stdout: "persistent": [ 2026-02-13T20:14:40.569 INFO:tasks.workunit.client.0.trial030.stdout: "kraken", 2026-02-13T20:14:40.569 INFO:tasks.workunit.client.0.trial030.stdout: "luminous", 2026-02-13T20:14:40.569 INFO:tasks.workunit.client.0.trial030.stdout: "mimic", 2026-02-13T20:14:40.569 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap-prune", 2026-02-13T20:14:40.570 INFO:tasks.workunit.client.0.trial030.stdout: "nautilus", 2026-02-13T20:14:40.570 INFO:tasks.workunit.client.0.trial030.stdout: "octopus", 2026-02-13T20:14:40.570 INFO:tasks.workunit.client.0.trial030.stdout: "pacific", 2026-02-13T20:14:40.570 INFO:tasks.workunit.client.0.trial030.stdout: "elector-pinging", 2026-02-13T20:14:40.570 INFO:tasks.workunit.client.0.trial030.stdout: "quincy", 2026-02-13T20:14:40.570 INFO:tasks.workunit.client.0.trial030.stdout: "reef", 2026-02-13T20:14:40.571 INFO:tasks.workunit.client.0.trial030.stdout: "squid", 2026-02-13T20:14:40.571 INFO:tasks.workunit.client.0.trial030.stdout: "tentacle", 2026-02-13T20:14:40.571 INFO:tasks.workunit.client.0.trial030.stdout: "nvmeof_beacon_diff" 2026-02-13T20:14:40.571 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:14:40.571 INFO:tasks.workunit.client.0.trial030.stdout: "optional": [] 2026-02-13T20:14:40.571 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.571 INFO:tasks.workunit.client.0.trial030.stdout: "mons": [ 2026-02-13T20:14:40.572 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.572 INFO:tasks.workunit.client.0.trial030.stdout: "rank": 0, 2026-02-13T20:14:40.572 INFO:tasks.workunit.client.0.trial030.stdout: "name": "a", 2026-02-13T20:14:40.572 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:14:40.572 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:14:40.572 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.573 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:14:40.573 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115", 2026-02-13T20:14:40.573 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 0 2026-02-13T20:14:40.573 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.573 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.573 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.574 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115/0", 2026-02-13T20:14:40.574 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-13T20:14:40.574 INFO:tasks.workunit.client.0.trial030.stdout: "priority": 0, 2026-02-13T20:14:40.574 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 0, 2026-02-13T20:14:40.574 INFO:tasks.workunit.client.0.trial030.stdout: "time_added": "2026-02-13T20:13:27:304837+0000", 2026-02-13T20:14:40.574 INFO:tasks.workunit.client.0.trial030.stdout: "crush_location": [] 2026-02-13T20:14:40.575 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.575 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.575 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.575 INFO:tasks.workunit.client.0.trial030.stdout: "quorum": [ 2026-02-13T20:14:40.575 INFO:tasks.workunit.client.0.trial030.stdout: 0 2026-02-13T20:14:40.575 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:14:40.575 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap": { 2026-02-13T20:14:40.576 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 45, 2026-02-13T20:14:40.576 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "76a1de22-3326-43d1-82f4-48cedec81b31", 2026-02-13T20:14:40.576 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-13T20:13:27.394246+0000", 2026-02-13T20:14:40.576 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-13T20:14:31.981701+0000", 2026-02-13T20:14:40.576 INFO:tasks.workunit.client.0.trial030.stdout: "last_up_change": "2026-02-13T20:14:08.620195+0000", 2026-02-13T20:14:40.576 INFO:tasks.workunit.client.0.trial030.stdout: "last_in_change": "2026-02-13T20:14:09.591275+0000", 2026-02-13T20:14:40.577 INFO:tasks.workunit.client.0.trial030.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-13T20:14:40.577 INFO:tasks.workunit.client.0.trial030.stdout: "flags_num": 5800384, 2026-02-13T20:14:40.577 INFO:tasks.workunit.client.0.trial030.stdout: "flags_set": [ 2026-02-13T20:14:40.577 INFO:tasks.workunit.client.0.trial030.stdout: "nodown", 2026-02-13T20:14:40.577 INFO:tasks.workunit.client.0.trial030.stdout: "noin", 2026-02-13T20:14:40.577 INFO:tasks.workunit.client.0.trial030.stdout: "noout", 2026-02-13T20:14:40.577 INFO:tasks.workunit.client.0.trial030.stdout: "pglog_hardlimit", 2026-02-13T20:14:40.578 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snapdirs", 2026-02-13T20:14:40.578 INFO:tasks.workunit.client.0.trial030.stdout: "recovery_deletes", 2026-02-13T20:14:40.578 INFO:tasks.workunit.client.0.trial030.stdout: "sortbitwise" 2026-02-13T20:14:40.578 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:14:40.578 INFO:tasks.workunit.client.0.trial030.stdout: "crush_version": 9, 2026-02-13T20:14:40.578 INFO:tasks.workunit.client.0.trial030.stdout: "full_ratio": 0.99000000953674316, 2026-02-13T20:14:40.578 INFO:tasks.workunit.client.0.trial030.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-13T20:14:40.579 INFO:tasks.workunit.client.0.trial030.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-13T20:14:40.579 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_snapshot": "", 2026-02-13T20:14:40.579 INFO:tasks.workunit.client.0.trial030.stdout: "pool_max": 1, 2026-02-13T20:14:40.579 INFO:tasks.workunit.client.0.trial030.stdout: "max_osd": 3, 2026-02-13T20:14:40.579 INFO:tasks.workunit.client.0.trial030.stdout: "require_min_compat_client": "luminous", 2026-02-13T20:14:40.579 INFO:tasks.workunit.client.0.trial030.stdout: "min_compat_client": "jewel", 2026-02-13T20:14:40.579 INFO:tasks.workunit.client.0.trial030.stdout: "require_osd_release": "tentacle", 2026-02-13T20:14:40.580 INFO:tasks.workunit.client.0.trial030.stdout: "allow_crimson": false, 2026-02-13T20:14:40.580 INFO:tasks.workunit.client.0.trial030.stdout: "pools": [ 2026-02-13T20:14:40.580 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.580 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-13T20:14:40.580 INFO:tasks.workunit.client.0.trial030.stdout: "pool_name": "test", 2026-02-13T20:14:40.580 INFO:tasks.workunit.client.0.trial030.stdout: "create_time": "2026-02-13T20:13:39.174951+0000", 2026-02-13T20:14:40.581 INFO:tasks.workunit.client.0.trial030.stdout: "flags": 1, 2026-02-13T20:14:40.581 INFO:tasks.workunit.client.0.trial030.stdout: "flags_names": "hashpspool", 2026-02-13T20:14:40.581 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-13T20:14:40.581 INFO:tasks.workunit.client.0.trial030.stdout: "size": 3, 2026-02-13T20:14:40.581 INFO:tasks.workunit.client.0.trial030.stdout: "min_size": 2, 2026-02-13T20:14:40.581 INFO:tasks.workunit.client.0.trial030.stdout: "crush_rule": 0, 2026-02-13T20:14:40.581 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_count": 0, 2026-02-13T20:14:40.581 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_target": 0, 2026-02-13T20:14:40.582 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_barrier": 0, 2026-02-13T20:14:40.582 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-13T20:14:40.582 INFO:tasks.workunit.client.0.trial030.stdout: "is_stretch_pool": false, 2026-02-13T20:14:40.582 INFO:tasks.workunit.client.0.trial030.stdout: "object_hash": 2, 2026-02-13T20:14:40.582 INFO:tasks.workunit.client.0.trial030.stdout: "pg_autoscale_mode": "on", 2026-02-13T20:14:40.582 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num": 32, 2026-02-13T20:14:40.582 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num": 1, 2026-02-13T20:14:40.583 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num_target": 32, 2026-02-13T20:14:40.583 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_target": 32, 2026-02-13T20:14:40.583 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_pending": 32, 2026-02-13T20:14:40.583 INFO:tasks.workunit.client.0.trial030.stdout: "last_pg_merge_meta": { 2026-02-13T20:14:40.583 INFO:tasks.workunit.client.0.trial030.stdout: "source_pgid": "0.0", 2026-02-13T20:14:40.583 INFO:tasks.workunit.client.0.trial030.stdout: "ready_epoch": 0, 2026-02-13T20:14:40.583 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_started": 0, 2026-02-13T20:14:40.583 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": 0, 2026-02-13T20:14:40.584 INFO:tasks.workunit.client.0.trial030.stdout: "source_version": "0'0", 2026-02-13T20:14:40.584 INFO:tasks.workunit.client.0.trial030.stdout: "target_version": "0'0" 2026-02-13T20:14:40.584 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.584 INFO:tasks.workunit.client.0.trial030.stdout: "last_change": "44", 2026-02-13T20:14:40.584 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend": "0", 2026-02-13T20:14:40.584 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-13T20:14:40.584 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_preluminous": "44", 2026-02-13T20:14:40.585 INFO:tasks.workunit.client.0.trial030.stdout: "auid": 0, 2026-02-13T20:14:40.585 INFO:tasks.workunit.client.0.trial030.stdout: "snap_mode": "selfmanaged", 2026-02-13T20:14:40.585 INFO:tasks.workunit.client.0.trial030.stdout: "snap_seq": 0, 2026-02-13T20:14:40.585 INFO:tasks.workunit.client.0.trial030.stdout: "snap_epoch": 0, 2026-02-13T20:14:40.585 INFO:tasks.workunit.client.0.trial030.stdout: "pool_snaps": [], 2026-02-13T20:14:40.585 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps": "[]", 2026-02-13T20:14:40.585 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_bytes": 0, 2026-02-13T20:14:40.585 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_objects": 0, 2026-02-13T20:14:40.586 INFO:tasks.workunit.client.0.trial030.stdout: "tiers": [], 2026-02-13T20:14:40.586 INFO:tasks.workunit.client.0.trial030.stdout: "tier_of": -1, 2026-02-13T20:14:40.586 INFO:tasks.workunit.client.0.trial030.stdout: "read_tier": -1, 2026-02-13T20:14:40.586 INFO:tasks.workunit.client.0.trial030.stdout: "write_tier": -1, 2026-02-13T20:14:40.586 INFO:tasks.workunit.client.0.trial030.stdout: "cache_mode": "none", 2026-02-13T20:14:40.586 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_bytes": 0, 2026-02-13T20:14:40.586 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_objects": 0, 2026-02-13T20:14:40.586 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-13T20:14:40.586 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-13T20:14:40.587 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-13T20:14:40.587 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_flush_age": 0, 2026-02-13T20:14:40.587 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_evict_age": 0, 2026-02-13T20:14:40.587 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profile": "", 2026-02-13T20:14:40.587 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_params": { 2026-02-13T20:14:40.587 INFO:tasks.workunit.client.0.trial030.stdout: "type": "none" 2026-02-13T20:14:40.587 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.587 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_period": 0, 2026-02-13T20:14:40.587 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_count": 0, 2026-02-13T20:14:40.588 INFO:tasks.workunit.client.0.trial030.stdout: "use_gmt_hitset": true, 2026-02-13T20:14:40.588 INFO:tasks.workunit.client.0.trial030.stdout: "min_read_recency_for_promote": 0, 2026-02-13T20:14:40.588 INFO:tasks.workunit.client.0.trial030.stdout: "min_write_recency_for_promote": 0, 2026-02-13T20:14:40.588 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_grade_decay_rate": 0, 2026-02-13T20:14:40.588 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_search_last_n": 0, 2026-02-13T20:14:40.588 INFO:tasks.workunit.client.0.trial030.stdout: "grade_table": [], 2026-02-13T20:14:40.588 INFO:tasks.workunit.client.0.trial030.stdout: "stripe_width": 0, 2026-02-13T20:14:40.588 INFO:tasks.workunit.client.0.trial030.stdout: "expected_num_objects": 0, 2026-02-13T20:14:40.588 INFO:tasks.workunit.client.0.trial030.stdout: "fast_read": false, 2026-02-13T20:14:40.588 INFO:tasks.workunit.client.0.trial030.stdout: "nonprimary_shards": "{}", 2026-02-13T20:14:40.588 INFO:tasks.workunit.client.0.trial030.stdout: "options": {}, 2026-02-13T20:14:40.589 INFO:tasks.workunit.client.0.trial030.stdout: "application_metadata": {}, 2026-02-13T20:14:40.589 INFO:tasks.workunit.client.0.trial030.stdout: "read_balance": { 2026-02-13T20:14:40.589 INFO:tasks.workunit.client.0.trial030.stdout: "score_type": "Fair distribution", 2026-02-13T20:14:40.589 INFO:tasks.workunit.client.0.trial030.stdout: "score_acting": 2.9900000095367432, 2026-02-13T20:14:40.589 INFO:tasks.workunit.client.0.trial030.stdout: "score_stable": 2.9900000095367432, 2026-02-13T20:14:40.589 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_score": 0.67000001668930054, 2026-02-13T20:14:40.589 INFO:tasks.workunit.client.0.trial030.stdout: "raw_score_acting": 2, 2026-02-13T20:14:40.589 INFO:tasks.workunit.client.0.trial030.stdout: "raw_score_stable": 2, 2026-02-13T20:14:40.589 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity_weighted": 1, 2026-02-13T20:14:40.590 INFO:tasks.workunit.client.0.trial030.stdout: "average_primary_affinity": 1, 2026-02-13T20:14:40.590 INFO:tasks.workunit.client.0.trial030.stdout: "average_primary_affinity_weighted": 1 2026-02-13T20:14:40.590 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.590 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.590 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:14:40.590 INFO:tasks.workunit.client.0.trial030.stdout: "osds": [ 2026-02-13T20:14:40.590 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.590 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:14:40.590 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "b6e085ae-f1ef-46b2-bb98-365b92356624", 2026-02-13T20:14:40.590 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-13T20:14:40.590 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-13T20:14:40.590 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-13T20:14:40.590 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-13T20:14:40.590 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 5, 2026-02-13T20:14:40.591 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 29, 2026-02-13T20:14:40.591 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 36, 2026-02-13T20:14:40.591 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 44, 2026-02-13T20:14:40.591 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 30, 2026-02-13T20:14:40.591 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-13T20:14:40.591 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:14:40.591 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:14:40.591 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.591 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:14:40.591 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6800", 2026-02-13T20:14:40.591 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1169190239 2026-02-13T20:14:40.591 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.591 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.591 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:14:40.591 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6801", 2026-02-13T20:14:40.591 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1169190239 2026-02-13T20:14:40.591 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.591 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.591 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.592 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-13T20:14:40.592 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:14:40.592 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.592 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:14:40.592 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6802", 2026-02-13T20:14:40.592 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1169190239 2026-02-13T20:14:40.592 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.592 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.592 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:14:40.592 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6803", 2026-02-13T20:14:40.592 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1169190239 2026-02-13T20:14:40.592 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.592 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.592 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.592 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-13T20:14:40.592 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:14:40.592 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.592 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:14:40.592 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6806", 2026-02-13T20:14:40.593 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1169190239 2026-02-13T20:14:40.593 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.593 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.593 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:14:40.593 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6807", 2026-02-13T20:14:40.593 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1169190239 2026-02-13T20:14:40.593 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.593 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.593 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.593 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-13T20:14:40.593 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:14:40.593 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.593 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:14:40.593 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6804", 2026-02-13T20:14:40.593 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1169190239 2026-02-13T20:14:40.593 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.593 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.593 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:14:40.593 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6805", 2026-02-13T20:14:40.593 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1169190239 2026-02-13T20:14:40.594 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.594 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.594 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.594 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6801/1169190239", 2026-02-13T20:14:40.594 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6803/1169190239", 2026-02-13T20:14:40.594 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6807/1169190239", 2026-02-13T20:14:40.594 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6805/1169190239", 2026-02-13T20:14:40.594 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-13T20:14:40.594 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-13T20:14:40.594 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-13T20:14:40.594 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.594 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.594 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.594 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:14:40.594 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "58e5ae01-f34d-4563-8340-e58b1e0c4c9c", 2026-02-13T20:14:40.594 INFO:tasks.workunit.client.0.trial030.stdout: "up": 0, 2026-02-13T20:14:40.594 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-13T20:14:40.594 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-13T20:14:40.594 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-13T20:14:40.594 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 0, 2026-02-13T20:14:40.595 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 0, 2026-02-13T20:14:40.595 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 10, 2026-02-13T20:14:40.595 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 21, 2026-02-13T20:14:40.595 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 31, 2026-02-13T20:14:40.595 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-13T20:14:40.595 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:14:40.595 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:14:40.595 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.595 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:14:40.595 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-13T20:14:40.595 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3416176909 2026-02-13T20:14:40.595 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.595 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.595 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:14:40.595 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-13T20:14:40.595 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3416176909 2026-02-13T20:14:40.595 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.595 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.595 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.595 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-13T20:14:40.595 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:14:40.595 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.596 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:14:40.596 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-13T20:14:40.596 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3416176909 2026-02-13T20:14:40.596 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.596 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.596 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:14:40.596 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-13T20:14:40.596 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3416176909 2026-02-13T20:14:40.596 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.596 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.596 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.596 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-13T20:14:40.596 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:14:40.596 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.596 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:14:40.596 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-13T20:14:40.596 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3416176909 2026-02-13T20:14:40.596 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.596 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.596 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:14:40.596 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-13T20:14:40.596 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3416176909 2026-02-13T20:14:40.597 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.597 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.597 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.597 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-13T20:14:40.597 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:14:40.597 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.597 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:14:40.597 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-13T20:14:40.597 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3416176909 2026-02-13T20:14:40.597 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.597 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.597 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:14:40.597 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-13T20:14:40.597 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3416176909 2026-02-13T20:14:40.597 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.597 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.597 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.597 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/3416176909", 2026-02-13T20:14:40.597 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/3416176909", 2026-02-13T20:14:40.597 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3416176909", 2026-02-13T20:14:40.597 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3416176909", 2026-02-13T20:14:40.597 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-13T20:14:40.598 INFO:tasks.workunit.client.0.trial030.stdout: "exists" 2026-02-13T20:14:40.598 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.598 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.598 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.598 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:14:40.598 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "d77b547d-75d9-49e5-86d4-8ccbd530ae28", 2026-02-13T20:14:40.598 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-13T20:14:40.598 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-13T20:14:40.598 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-13T20:14:40.598 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-13T20:14:40.598 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 14, 2026-02-13T20:14:40.598 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 29, 2026-02-13T20:14:40.598 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 38, 2026-02-13T20:14:40.598 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 0, 2026-02-13T20:14:40.598 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 32, 2026-02-13T20:14:40.598 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-13T20:14:40.598 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:14:40.598 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:14:40.598 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.598 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:14:40.598 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-13T20:14:40.598 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2057545651 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2057545651 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2057545651 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2057545651 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.599 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2057545651 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2057545651 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2057545651 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-13T20:14:40.600 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2057545651 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/2057545651", 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/2057545651", 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2057545651", 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2057545651", 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: "osd_xinfo": [ 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-13T20:14:04.374192+0000", 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-13T20:13:31.010634+0000", 2026-02-13T20:14:40.601 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-13T20:14:04.666891+0000", 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-13T20:14:04.955660+0000", 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-13T20:13:37.245364+0000", 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap": [], 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_items": [], 2026-02-13T20:14:40.602 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_primaries": [], 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: "pg_temp": [], 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: "primary_temp": [], 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: "blocklist": {}, 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: "range_blocklist": {}, 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profiles": { 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: "default": { 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: "k": "2", 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: "m": "2", 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: "plugin": "isa", 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: "technique": "reed_sol_van" 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps_queue": [], 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: "new_removed_snaps": [], 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: "new_purged_snaps": [], 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: "crush_node_flags": {}, 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: "device_class_flags": {}, 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": { 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_enabled": false, 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_bucket_count": 0, 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: "degraded_stretch_mode": 0, 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: "recovering_stretch_mode": 0, 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_bucket": 0 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.603 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "osd_metadata": [ 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6802/1169190239,v1:127.0.0.1:6803/1169190239]", 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T20:14:40.604 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-13T20:14:40.605 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-13T20:14:40.605 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:14:40.605 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-13T20:14:40.605 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:14:40.605 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T20:14:40.605 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-13T20:13:28.365182Z", 2026-02-13T20:14:40.605 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-13T20:14:40.605 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-13T20:14:40.605 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T20:14:40.605 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-13T20:14:40.605 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-13T20:14:40.605 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T20:14:40.605 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-13T20:14:40.605 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6800/1169190239,v1:127.0.0.1:6801/1169190239]", 2026-02-13T20:14:40.605 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-13T20:14:40.605 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/1169190239,v1:127.0.0.1:6807/1169190239]", 2026-02-13T20:14:40.605 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/1169190239,v1:127.0.0.1:6805/1169190239]", 2026-02-13T20:14:40.605 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-13T20:14:40.605 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-13T20:14:40.605 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961704", 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/0", 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/3416176909,v1:127.0.0.1:6813/3416176909]", 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-13T20:14:40.606 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-13T20:13:31.960202Z", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-13T20:14:40.607 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/3416176909,v1:127.0.0.1:6811/3416176909]", 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3416176909,v1:127.0.0.1:6817/3416176909]", 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3416176909,v1:127.0.0.1:6815/3416176909]", 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961704", 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/1", 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:14:40.608 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/2057545651,v1:127.0.0.1:6813/2057545651]", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-13T20:14:40.609 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-13T20:13:34.819765Z", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/2057545651,v1:127.0.0.1:6811/2057545651]", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2057545651,v1:127.0.0.1:6817/2057545651]", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2057545651,v1:127.0.0.1:6815/2057545651]", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961704", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/2", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-13T20:14:40.610 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_clean_epochs": { 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: "min_last_epoch_clean": 0, 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": { 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: "per_pool": [] 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: "osd_epochs": [ 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 36 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 39 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_first_committed": 1, 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_last_committed": 45, 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: "crushmap": { 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: "devices": [ 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.0", 2026-02-13T20:14:40.611 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.1", 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.2", 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: "types": [ 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 0, 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd" 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: "name": "host" 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 2, 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: "name": "chassis" 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 3, 2026-02-13T20:14:40.612 INFO:tasks.workunit.client.0.trial030.stdout: "name": "rack" 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 4, 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: "name": "row" 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 5, 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pdu" 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 6, 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pod" 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 7, 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: "name": "room" 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 8, 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: "name": "datacenter" 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 9, 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: "name": "zone" 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.613 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 10, 2026-02-13T20:14:40.614 INFO:tasks.workunit.client.0.trial030.stderr:report 4054238607 2026-02-13T20:14:40.614 INFO:tasks.workunit.client.0.trial030.stdout: "name": "region" 2026-02-13T20:14:40.614 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.614 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.614 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-13T20:14:40.614 INFO:tasks.workunit.client.0.trial030.stdout: "name": "root" 2026-02-13T20:14:40.614 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.614 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:14:40.614 INFO:tasks.workunit.client.0.trial030.stdout: "buckets": [ 2026-02-13T20:14:40.614 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.614 INFO:tasks.workunit.client.0.trial030.stdout: "id": -1, 2026-02-13T20:14:40.614 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default", 2026-02-13T20:14:40.614 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-13T20:14:40.614 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-13T20:14:40.614 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:14:40.614 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: "id": -2, 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default~ssd", 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-13T20:14:40.615 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030", 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030~ssd", 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-13T20:14:40.616 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: "rules": [ 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: "rule_id": 0, 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: "rule_name": "replicated_rule", 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: "steps": [ 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: "op": "take", 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: "item": -1, 2026-02-13T20:14:40.617 INFO:tasks.workunit.client.0.trial030.stdout: "item_name": "default" 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "op": "choose_firstn", 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "num": 0, 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "type": "osd" 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "op": "emit" 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "tunables": { 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_tries": 0, 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_fallback_tries": 0, 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "choose_total_tries": 50, 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_descend_once": 1, 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_vary_r": 1, 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_stable": 1, 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "msr_descents": 100, 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "msr_collision_tries": 100, 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "straw_calc_version": 1, 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "allowed_bucket_algs": 54, 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "profile": "jewel", 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_tunables": 1, 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "legacy_tunables": 0, 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "minimum_required_version": "jewel", 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables": 1, 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables2": 1, 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "has_v2_rules": 0, 2026-02-13T20:14:40.618 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables3": 1, 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "has_v3_rules": 0, 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "has_v4_buckets": 1, 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables5": 1, 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "has_v5_rules": 0, 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "has_msr_rules": 0 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "choose_args": {} 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "fsmap": { 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "btime": "2026-02-13T20:13:27:394010+0000", 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "default_fscid": -1, 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "compat": { 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "compat": {}, 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "ro_compat": {}, 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "incompat": { 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "feature_1": "base v0.20", 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "feature_2": "client writeable ranges", 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "feature_3": "default file layouts on dirs", 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "feature_4": "dir inode in separate object", 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "feature_5": "mds uses versioned encoding", 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "feature_8": "no anchor table", 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "feature_9": "file layout v2", 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "feature_10": "snaprealm v2", 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "feature_11": "minor log segments", 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "feature_12": "quiesce subvolumes" 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "feature_flags": { 2026-02-13T20:14:40.619 INFO:tasks.workunit.client.0.trial030.stdout: "enable_multiple": true, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "ever_enabled_multiple": true 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "standbys": [], 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "filesystems": [] 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_first_committed": 1, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_last_committed": 1, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "auth": { 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 5, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_secrets": 3 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 32, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_active": 32, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_unknown": 0, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_osd": 3, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "pool_sum": { 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 51200, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 100, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 0, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 300, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 100, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 100, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 100, 2026-02-13T20:14:40.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 100, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 0, 2026-02-13T20:14:40.621 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 512, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 512, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "up": 64, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 64, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 0 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum": { 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 65, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83952, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2168, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 28, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81699, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488848, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036580352, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2220032, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 456137, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:14:40.622 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 29315, 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83660157 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum_by_class": { 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "ssd": { 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 65, 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83952, 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2168, 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 28, 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81699, 2026-02-13T20:14:40.623 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488848, 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036580352, 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2220032, 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 456137, 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 29315, 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83660157 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "pool_stats": [ 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": 1, 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 32, 2026-02-13T20:14:40.624 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 51200, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 100, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 300, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 100, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 100, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 100, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 100, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-13T20:14:40.625 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 1220608, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 153552, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 512, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 512, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "up": 64, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 64, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 3 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "osd_stats": [ 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 154618822665 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 42949672972 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 163208757257 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.626 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_state": [ 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: "state": "active+undersized+degraded", 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: "num": 31 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: "state": "active+undersized+degraded+wait", 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: "num": 1 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: "pool_pg_unavailable_map": [ 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": "1", 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: "pgs": [] 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_osd": [ 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 32, 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 32, 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 32, 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 0, 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:14:40.627 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": [ 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": {} 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "servicemap": { 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 3, 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-13T20:14:35.816602+0000", 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "services": { 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "osd": { 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "daemons": { 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "summary": "", 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "0": { 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "start_epoch": 0, 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "start_stamp": "0.000000", 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "gid": 0, 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "metadata": {}, 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "task_status": {} 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "2": { 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "start_epoch": 0, 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "start_stamp": "0.000000", 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "gid": 0, 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "metadata": {}, 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "task_status": {} 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_first_committed": 1, 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_last_committed": 37, 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "logm_first_committed": 1, 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "logm_last_committed": 221, 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "paxos": { 2026-02-13T20:14:40.628 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-13T20:14:40.629 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 314, 2026-02-13T20:14:40.629 INFO:tasks.workunit.client.0.trial030.stdout: "last_pn": 0, 2026-02-13T20:14:40.629 INFO:tasks.workunit.client.0.trial030.stdout: "accepted_pn": 0 2026-02-13T20:14:40.629 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:14:40.629 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-13T20:14:40.629 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-13T20:14:40.629 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:755: TEST_divergent_3: expr 2 + 2 2026-02-13T20:14:40.629 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:755: TEST_divergent_3: objname=existing_4 2026-02-13T20:14:40.629 INFO:tasks.workunit.client.0.trial030.stdout:writing non-divergent object existing_4 2026-02-13T20:14:40.629 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:756: TEST_divergent_3: echo 'writing non-divergent object existing_4' 2026-02-13T20:14:40.629 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:757: TEST_divergent_3: ceph pg dump pgs 2026-02-13T20:14:40.771 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:14:40.771 INFO:tasks.workunit.client.0.trial030.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994145+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.771 INFO:tasks.workunit.client.0.trial030.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991961+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.771 INFO:tasks.workunit.client.0.trial030.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991399+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.771 INFO:tasks.workunit.client.0.trial030.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.993586+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.771 INFO:tasks.workunit.client.0.trial030.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992275+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.771 INFO:tasks.workunit.client.0.trial030.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992208+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.771 INFO:tasks.workunit.client.0.trial030.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992179+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994740+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.993520+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.993680+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994131+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994158+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992293+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992500+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992453+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991699+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded+wait 2026-02-13T20:14:31.989318+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992123+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994209+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994489+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.990898+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991446+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991576+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992220+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991936+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991795+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991811+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994164+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991374+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991490+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991085+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992012+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:14:40.772 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:14:40.773 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:14:40.773 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:14:40.780 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:758: TEST_divergent_3: rados -p test put existing_4 /tmp/tmp.NbbgnxSrsZ 2026-02-13T20:14:40.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:760: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-13T20:14:40.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:760: TEST_divergent_3: wait_for_clean 2026-02-13T20:14:40.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T20:14:40.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T20:14:40.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T20:14:40.803 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-13T20:14:40.804 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T20:14:40.804 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T20:14:40.804 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T20:14:40.804 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T20:14:40.805 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T20:14:40.875 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-13T20:14:40.875 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T20:14:40.875 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T20:14:40.875 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T20:14:40.875 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T20:14:40.875 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T20:14:41.088 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T20:14:41.089 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:14:41.089 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:14:41.089 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T20:14:41.089 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:14:41.089 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-13T20:14:41.174 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822667 2026-02-13T20:14:41.174 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822667 2026-02-13T20:14:41.174 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-154618822667' 2026-02-13T20:14:41.174 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:14:41.174 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-13T20:14:41.239 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-13T20:14:41.239 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-13T20:14:41.239 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-13T20:14:41.239 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-13T20:14:41.239 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:14:41.239 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-13T20:14:41.323 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757259 2026-02-13T20:14:41.323 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757259 2026-02-13T20:14:41.323 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-154618822667 2-163208757259' 2026-02-13T20:14:41.323 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:14:41.323 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-154618822667 2026-02-13T20:14:41.323 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:14:41.325 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-13T20:14:41.325 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-154618822667 2026-02-13T20:14:41.326 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:14:41.327 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822667 2026-02-13T20:14:41.327 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 154618822667' 2026-02-13T20:14:41.327 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 154618822667 2026-02-13T20:14:41.327 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:14:41.551 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822665 -lt 154618822667 2026-02-13T20:14:41.552 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:14:42.552 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T20:14:42.553 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:14:42.771 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822667 -lt 154618822667 2026-02-13T20:14:42.771 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:14:42.772 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-163208757259 2026-02-13T20:14:42.772 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:14:42.773 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-13T20:14:42.774 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-163208757259 2026-02-13T20:14:42.774 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:14:42.775 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757259 2026-02-13T20:14:42.775 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 163208757259' 2026-02-13T20:14:42.776 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 163208757259 2026-02-13T20:14:42.776 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:14:43.008 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757259 -lt 163208757259 2026-02-13T20:14:43.009 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T20:14:43.009 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:14:43.009 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:14:43.294 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 32 == 0 2026-02-13T20:14:43.294 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:14:43.294 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:14:43.294 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:14:43.294 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:14:43.294 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:14:43.295 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:14:43.295 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:14:43.501 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:14:43.501 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:14:43.502 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:14:43.502 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:14:43.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-13T20:14:43.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-13T20:14:43.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-13T20:14:43.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-13T20:14:43.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:14:43.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-13T20:14:43.885 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:14:43.885 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:14:43.886 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:14:43.886 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:14:43.886 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:14:43.886 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:14:43.886 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:14:43.886 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:14:44.101 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:14:44.102 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:14:44.102 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:14:44.102 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:14:44.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-13T20:14:44.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:14:44.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:14:44.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:14:44.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:14:44.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:14:44.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:14:44.382 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:14:44.382 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:14:44.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:14:44.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:14:44.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-13T20:14:44.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:14:44.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-13T20:14:44.862 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:14:44.863 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:14:44.864 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:14:44.864 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:14:44.864 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:14:44.864 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:14:44.864 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:14:44.864 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:14:45.077 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:14:45.077 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:14:45.078 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:14:45.078 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:14:45.357 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-13T20:14:45.357 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:14:45.357 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:14:45.357 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:14:45.357 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:14:45.357 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:14:45.357 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:14:45.358 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:14:45.358 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:14:45.638 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:14:45.639 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:14:45.639 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-13T20:14:45.639 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:14:45.639 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-13T20:14:46.039 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:14:46.039 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:14:46.039 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:14:46.039 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:14:46.039 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:14:46.040 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:14:46.040 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:14:46.040 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:14:46.251 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:14:46.251 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:14:46.252 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:14:46.252 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:14:46.533 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-13T20:14:46.533 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:14:46.533 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:14:46.534 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:14:46.534 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:14:46.534 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:14:46.534 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:14:46.534 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:14:46.534 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:14:46.817 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:14:46.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:14:46.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-13T20:14:46.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:14:46.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-13T20:14:47.618 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:14:47.619 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:14:47.620 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:14:47.620 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:14:47.620 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:14:47.620 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:14:47.620 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:14:47.620 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:14:47.829 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:14:47.830 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:14:47.830 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:14:47.830 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:14:48.120 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-13T20:14:48.120 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:14:48.120 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:14:48.120 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:14:48.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:14:48.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:14:48.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:14:48.121 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:14:48.121 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:14:48.400 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:14:48.401 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:14:48.401 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-13T20:14:48.401 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:14:48.401 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-13T20:14:50.002 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:14:50.002 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:14:50.003 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:14:50.003 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:14:50.003 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:14:50.003 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:14:50.003 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:14:50.004 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:14:50.224 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:14:50.225 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:14:50.225 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:14:50.225 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:14:50.515 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-13T20:14:50.515 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:14:50.515 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:14:50.515 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:14:50.515 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:14:50.515 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:14:50.515 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:14:50.516 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:14:50.516 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:14:50.804 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:14:50.804 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:14:50.804 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-13T20:14:50.804 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:14:50.804 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-13T20:14:54.004 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:14:54.005 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:14:54.005 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:14:54.006 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:14:54.006 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:14:54.006 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:14:54.006 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:14:54.006 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:14:54.225 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:14:54.226 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:14:54.226 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:14:54.226 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:14:54.520 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-13T20:14:54.520 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:14:54.520 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:14:54.520 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:14:54.520 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:14:54.520 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:14:54.521 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:14:54.521 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:14:54.521 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:14:54.800 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:14:54.800 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:14:54.800 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-13T20:14:54.800 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:14:54.800 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-13T20:15:01.202 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:15:01.202 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:15:01.203 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:15:01.203 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:15:01.203 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:15:01.203 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:15:01.204 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:15:01.204 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:15:01.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:15:01.426 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:15:01.426 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:15:01.426 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:15:01.707 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-13T20:15:01.707 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:15:01.707 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:15:01.707 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:15:01.707 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:15:01.707 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:15:01.707 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:15:01.708 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:15:01.708 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:15:01.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:15:01.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:15:01.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-13T20:15:01.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:15:01.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-13T20:15:09.299 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:15:09.299 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:15:09.300 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:15:09.301 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:15:09.301 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:15:09.301 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:15:09.301 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:15:09.301 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:15:09.517 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:15:09.518 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:15:09.518 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:15:09.518 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:15:09.807 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-13T20:15:09.807 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:15:09.808 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:15:09.808 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:15:09.808 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:15:09.808 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:15:09.808 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:15:09.808 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:15:09.808 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:15:10.097 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:15:10.097 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:15:10.097 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-13T20:15:10.097 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-13T20:15:10.380 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-13T20:15:10.381 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_fingerprint": "5040d525-f45b-4ab5-a639-5eac6ba9f32e", 2026-02-13T20:15:10.381 INFO:tasks.workunit.client.0.trial030.stdout: "version": "20.3.0-5230-gafefaa40", 2026-02-13T20:15:10.381 INFO:tasks.workunit.client.0.trial030.stdout: "commit": "afefaa40503a4bf024e96f97dd7f852b75f00ad6", 2026-02-13T20:15:10.381 INFO:tasks.workunit.client.0.trial030.stdout: "timestamp": "2026-02-13T20:15:10.380153+0000", 2026-02-13T20:15:10.381 INFO:tasks.workunit.client.0.trial030.stdout: "tag": "", 2026-02-13T20:15:10.381 INFO:tasks.workunit.client.0.trial030.stdout: "health": { 2026-02-13T20:15:10.381 INFO:tasks.workunit.client.0.trial030.stdout: "status": "HEALTH_WARN", 2026-02-13T20:15:10.382 INFO:tasks.workunit.client.0.trial030.stdout: "checks": { 2026-02-13T20:15:10.382 INFO:tasks.workunit.client.0.trial030.stdout: "OSDMAP_FLAGS": { 2026-02-13T20:15:10.382 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-13T20:15:10.382 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-13T20:15:10.382 INFO:tasks.workunit.client.0.trial030.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-13T20:15:10.382 INFO:tasks.workunit.client.0.trial030.stdout: "count": 17 2026-02-13T20:15:10.382 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.382 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [], 2026-02-13T20:15:10.383 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-13T20:15:10.383 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.383 INFO:tasks.workunit.client.0.trial030.stdout: "OSD_DOWN": { 2026-02-13T20:15:10.383 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-13T20:15:10.383 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-13T20:15:10.383 INFO:tasks.workunit.client.0.trial030.stdout: "message": "1 osds down", 2026-02-13T20:15:10.383 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-13T20:15:10.383 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.384 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-13T20:15:10.384 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.384 INFO:tasks.workunit.client.0.trial030.stdout: "message": "osd.1 (root=default,host=trial030) is down" 2026-02-13T20:15:10.384 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.384 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:15:10.384 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-13T20:15:10.384 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.384 INFO:tasks.workunit.client.0.trial030.stdout: "PG_DEGRADED": { 2026-02-13T20:15:10.385 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-13T20:15:10.385 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-13T20:15:10.385 INFO:tasks.workunit.client.0.trial030.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2026-02-13T20:15:10.385 INFO:tasks.workunit.client.0.trial030.stdout: "count": 32 2026-02-13T20:15:10.385 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.385 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-13T20:15:10.385 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.385 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.386 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.386 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.386 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.386 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.386 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.386 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.386 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.386 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.387 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.387 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.387 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.387 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.387 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.387 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.387 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.387 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.387 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.388 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.388 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.388 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.388 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.388 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.388 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.388 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.388 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.388 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.388 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.388 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.388 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.388 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.389 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.389 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.389 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.389 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.389 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.389 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.389 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.389 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.389 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.389 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.389 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.389 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.390 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.390 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.390 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.390 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.390 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.390 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.390 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.390 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.390 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.390 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.390 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.390 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.390 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.391 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.391 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.391 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.391 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.391 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.391 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.391 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.391 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.391 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.391 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.391 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.391 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.392 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.392 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.392 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.392 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.392 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.392 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.392 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.392 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.392 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.392 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.392 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.392 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.392 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.393 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.393 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.393 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.393 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.393 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.393 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.393 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.393 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.393 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.393 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.393 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.393 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.394 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2026-02-13T20:15:10.394 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.394 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:15:10.394 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-13T20:15:10.394 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.394 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.394 INFO:tasks.workunit.client.0.trial030.stdout: "mutes": [] 2026-02-13T20:15:10.394 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.394 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_first_committed": 1, 2026-02-13T20:15:10.394 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_last_committed": 1, 2026-02-13T20:15:10.394 INFO:tasks.workunit.client.0.trial030.stdout: "monmap": { 2026-02-13T20:15:10.394 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-13T20:15:10.394 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "76a1de22-3326-43d1-82f4-48cedec81b31", 2026-02-13T20:15:10.395 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-13T20:13:27.304842Z", 2026-02-13T20:15:10.395 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-13T20:13:27.304842Z", 2026-02-13T20:15:10.395 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release": 20, 2026-02-13T20:15:10.395 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:15:10.395 INFO:tasks.workunit.client.0.trial030.stdout: "election_strategy": 1, 2026-02-13T20:15:10.395 INFO:tasks.workunit.client.0.trial030.stdout: "disallowed_leaders": "", 2026-02-13T20:15:10.395 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": false, 2026-02-13T20:15:10.395 INFO:tasks.workunit.client.0.trial030.stdout: "tiebreaker_mon": "", 2026-02-13T20:15:10.395 INFO:tasks.workunit.client.0.trial030.stdout: "removed_ranks": "", 2026-02-13T20:15:10.395 INFO:tasks.workunit.client.0.trial030.stdout: "features": { 2026-02-13T20:15:10.395 INFO:tasks.workunit.client.0.trial030.stdout: "persistent": [ 2026-02-13T20:15:10.395 INFO:tasks.workunit.client.0.trial030.stdout: "kraken", 2026-02-13T20:15:10.395 INFO:tasks.workunit.client.0.trial030.stdout: "luminous", 2026-02-13T20:15:10.396 INFO:tasks.workunit.client.0.trial030.stdout: "mimic", 2026-02-13T20:15:10.396 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap-prune", 2026-02-13T20:15:10.396 INFO:tasks.workunit.client.0.trial030.stdout: "nautilus", 2026-02-13T20:15:10.396 INFO:tasks.workunit.client.0.trial030.stdout: "octopus", 2026-02-13T20:15:10.396 INFO:tasks.workunit.client.0.trial030.stdout: "pacific", 2026-02-13T20:15:10.396 INFO:tasks.workunit.client.0.trial030.stdout: "elector-pinging", 2026-02-13T20:15:10.396 INFO:tasks.workunit.client.0.trial030.stdout: "quincy", 2026-02-13T20:15:10.396 INFO:tasks.workunit.client.0.trial030.stdout: "reef", 2026-02-13T20:15:10.396 INFO:tasks.workunit.client.0.trial030.stdout: "squid", 2026-02-13T20:15:10.396 INFO:tasks.workunit.client.0.trial030.stdout: "tentacle", 2026-02-13T20:15:10.396 INFO:tasks.workunit.client.0.trial030.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:10.396 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:15:10.396 INFO:tasks.workunit.client.0.trial030.stdout: "optional": [] 2026-02-13T20:15:10.397 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.397 INFO:tasks.workunit.client.0.trial030.stdout: "mons": [ 2026-02-13T20:15:10.397 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.397 INFO:tasks.workunit.client.0.trial030.stdout: "rank": 0, 2026-02-13T20:15:10.397 INFO:tasks.workunit.client.0.trial030.stdout: "name": "a", 2026-02-13T20:15:10.397 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:15:10.397 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:15:10.397 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.397 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:15:10.397 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115", 2026-02-13T20:15:10.397 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 0 2026-02-13T20:15:10.397 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.398 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.398 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.398 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115/0", 2026-02-13T20:15:10.398 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-13T20:15:10.398 INFO:tasks.workunit.client.0.trial030.stdout: "priority": 0, 2026-02-13T20:15:10.398 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 0, 2026-02-13T20:15:10.398 INFO:tasks.workunit.client.0.trial030.stdout: "time_added": "2026-02-13T20:13:27:304837+0000", 2026-02-13T20:15:10.398 INFO:tasks.workunit.client.0.trial030.stdout: "crush_location": [] 2026-02-13T20:15:10.398 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.398 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.398 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.398 INFO:tasks.workunit.client.0.trial030.stdout: "quorum": [ 2026-02-13T20:15:10.398 INFO:tasks.workunit.client.0.trial030.stdout: 0 2026-02-13T20:15:10.399 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:15:10.399 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap": { 2026-02-13T20:15:10.399 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 45, 2026-02-13T20:15:10.399 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "76a1de22-3326-43d1-82f4-48cedec81b31", 2026-02-13T20:15:10.399 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-13T20:13:27.394246+0000", 2026-02-13T20:15:10.399 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-13T20:14:31.981701+0000", 2026-02-13T20:15:10.399 INFO:tasks.workunit.client.0.trial030.stdout: "last_up_change": "2026-02-13T20:14:08.620195+0000", 2026-02-13T20:15:10.399 INFO:tasks.workunit.client.0.trial030.stdout: "last_in_change": "2026-02-13T20:14:09.591275+0000", 2026-02-13T20:15:10.399 INFO:tasks.workunit.client.0.trial030.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-13T20:15:10.399 INFO:tasks.workunit.client.0.trial030.stdout: "flags_num": 5800384, 2026-02-13T20:15:10.399 INFO:tasks.workunit.client.0.trial030.stdout: "flags_set": [ 2026-02-13T20:15:10.399 INFO:tasks.workunit.client.0.trial030.stdout: "nodown", 2026-02-13T20:15:10.399 INFO:tasks.workunit.client.0.trial030.stdout: "noin", 2026-02-13T20:15:10.400 INFO:tasks.workunit.client.0.trial030.stdout: "noout", 2026-02-13T20:15:10.400 INFO:tasks.workunit.client.0.trial030.stdout: "pglog_hardlimit", 2026-02-13T20:15:10.400 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snapdirs", 2026-02-13T20:15:10.400 INFO:tasks.workunit.client.0.trial030.stdout: "recovery_deletes", 2026-02-13T20:15:10.400 INFO:tasks.workunit.client.0.trial030.stdout: "sortbitwise" 2026-02-13T20:15:10.400 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:15:10.400 INFO:tasks.workunit.client.0.trial030.stdout: "crush_version": 9, 2026-02-13T20:15:10.400 INFO:tasks.workunit.client.0.trial030.stdout: "full_ratio": 0.99000000953674316, 2026-02-13T20:15:10.400 INFO:tasks.workunit.client.0.trial030.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-13T20:15:10.400 INFO:tasks.workunit.client.0.trial030.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-13T20:15:10.400 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_snapshot": "", 2026-02-13T20:15:10.400 INFO:tasks.workunit.client.0.trial030.stdout: "pool_max": 1, 2026-02-13T20:15:10.400 INFO:tasks.workunit.client.0.trial030.stdout: "max_osd": 3, 2026-02-13T20:15:10.401 INFO:tasks.workunit.client.0.trial030.stdout: "require_min_compat_client": "luminous", 2026-02-13T20:15:10.401 INFO:tasks.workunit.client.0.trial030.stdout: "min_compat_client": "jewel", 2026-02-13T20:15:10.401 INFO:tasks.workunit.client.0.trial030.stdout: "require_osd_release": "tentacle", 2026-02-13T20:15:10.401 INFO:tasks.workunit.client.0.trial030.stdout: "allow_crimson": false, 2026-02-13T20:15:10.401 INFO:tasks.workunit.client.0.trial030.stdout: "pools": [ 2026-02-13T20:15:10.401 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.401 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-13T20:15:10.401 INFO:tasks.workunit.client.0.trial030.stdout: "pool_name": "test", 2026-02-13T20:15:10.401 INFO:tasks.workunit.client.0.trial030.stdout: "create_time": "2026-02-13T20:13:39.174951+0000", 2026-02-13T20:15:10.401 INFO:tasks.workunit.client.0.trial030.stdout: "flags": 1, 2026-02-13T20:15:10.401 INFO:tasks.workunit.client.0.trial030.stdout: "flags_names": "hashpspool", 2026-02-13T20:15:10.401 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-13T20:15:10.402 INFO:tasks.workunit.client.0.trial030.stdout: "size": 3, 2026-02-13T20:15:10.402 INFO:tasks.workunit.client.0.trial030.stdout: "min_size": 2, 2026-02-13T20:15:10.402 INFO:tasks.workunit.client.0.trial030.stdout: "crush_rule": 0, 2026-02-13T20:15:10.402 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_count": 0, 2026-02-13T20:15:10.402 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_target": 0, 2026-02-13T20:15:10.402 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_barrier": 0, 2026-02-13T20:15:10.402 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-13T20:15:10.402 INFO:tasks.workunit.client.0.trial030.stdout: "is_stretch_pool": false, 2026-02-13T20:15:10.402 INFO:tasks.workunit.client.0.trial030.stdout: "object_hash": 2, 2026-02-13T20:15:10.402 INFO:tasks.workunit.client.0.trial030.stdout: "pg_autoscale_mode": "on", 2026-02-13T20:15:10.402 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num": 32, 2026-02-13T20:15:10.402 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num": 1, 2026-02-13T20:15:10.402 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num_target": 32, 2026-02-13T20:15:10.403 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_target": 32, 2026-02-13T20:15:10.403 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_pending": 32, 2026-02-13T20:15:10.403 INFO:tasks.workunit.client.0.trial030.stdout: "last_pg_merge_meta": { 2026-02-13T20:15:10.403 INFO:tasks.workunit.client.0.trial030.stdout: "source_pgid": "0.0", 2026-02-13T20:15:10.403 INFO:tasks.workunit.client.0.trial030.stdout: "ready_epoch": 0, 2026-02-13T20:15:10.403 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_started": 0, 2026-02-13T20:15:10.403 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": 0, 2026-02-13T20:15:10.403 INFO:tasks.workunit.client.0.trial030.stdout: "source_version": "0'0", 2026-02-13T20:15:10.403 INFO:tasks.workunit.client.0.trial030.stdout: "target_version": "0'0" 2026-02-13T20:15:10.403 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.403 INFO:tasks.workunit.client.0.trial030.stdout: "last_change": "44", 2026-02-13T20:15:10.403 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend": "0", 2026-02-13T20:15:10.403 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-13T20:15:10.404 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_preluminous": "44", 2026-02-13T20:15:10.404 INFO:tasks.workunit.client.0.trial030.stdout: "auid": 0, 2026-02-13T20:15:10.404 INFO:tasks.workunit.client.0.trial030.stdout: "snap_mode": "selfmanaged", 2026-02-13T20:15:10.404 INFO:tasks.workunit.client.0.trial030.stdout: "snap_seq": 0, 2026-02-13T20:15:10.404 INFO:tasks.workunit.client.0.trial030.stdout: "snap_epoch": 0, 2026-02-13T20:15:10.404 INFO:tasks.workunit.client.0.trial030.stdout: "pool_snaps": [], 2026-02-13T20:15:10.404 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps": "[]", 2026-02-13T20:15:10.404 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_bytes": 0, 2026-02-13T20:15:10.404 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_objects": 0, 2026-02-13T20:15:10.404 INFO:tasks.workunit.client.0.trial030.stdout: "tiers": [], 2026-02-13T20:15:10.404 INFO:tasks.workunit.client.0.trial030.stdout: "tier_of": -1, 2026-02-13T20:15:10.404 INFO:tasks.workunit.client.0.trial030.stdout: "read_tier": -1, 2026-02-13T20:15:10.404 INFO:tasks.workunit.client.0.trial030.stdout: "write_tier": -1, 2026-02-13T20:15:10.405 INFO:tasks.workunit.client.0.trial030.stdout: "cache_mode": "none", 2026-02-13T20:15:10.405 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_bytes": 0, 2026-02-13T20:15:10.405 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_objects": 0, 2026-02-13T20:15:10.405 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-13T20:15:10.405 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-13T20:15:10.405 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-13T20:15:10.405 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_flush_age": 0, 2026-02-13T20:15:10.405 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_evict_age": 0, 2026-02-13T20:15:10.405 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profile": "", 2026-02-13T20:15:10.405 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_params": { 2026-02-13T20:15:10.405 INFO:tasks.workunit.client.0.trial030.stdout: "type": "none" 2026-02-13T20:15:10.405 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.405 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_period": 0, 2026-02-13T20:15:10.406 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_count": 0, 2026-02-13T20:15:10.406 INFO:tasks.workunit.client.0.trial030.stdout: "use_gmt_hitset": true, 2026-02-13T20:15:10.406 INFO:tasks.workunit.client.0.trial030.stdout: "min_read_recency_for_promote": 0, 2026-02-13T20:15:10.406 INFO:tasks.workunit.client.0.trial030.stdout: "min_write_recency_for_promote": 0, 2026-02-13T20:15:10.406 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_grade_decay_rate": 0, 2026-02-13T20:15:10.406 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_search_last_n": 0, 2026-02-13T20:15:10.406 INFO:tasks.workunit.client.0.trial030.stdout: "grade_table": [], 2026-02-13T20:15:10.406 INFO:tasks.workunit.client.0.trial030.stdout: "stripe_width": 0, 2026-02-13T20:15:10.406 INFO:tasks.workunit.client.0.trial030.stdout: "expected_num_objects": 0, 2026-02-13T20:15:10.406 INFO:tasks.workunit.client.0.trial030.stdout: "fast_read": false, 2026-02-13T20:15:10.406 INFO:tasks.workunit.client.0.trial030.stdout: "nonprimary_shards": "{}", 2026-02-13T20:15:10.406 INFO:tasks.workunit.client.0.trial030.stdout: "options": {}, 2026-02-13T20:15:10.406 INFO:tasks.workunit.client.0.trial030.stdout: "application_metadata": {}, 2026-02-13T20:15:10.407 INFO:tasks.workunit.client.0.trial030.stdout: "read_balance": { 2026-02-13T20:15:10.407 INFO:tasks.workunit.client.0.trial030.stdout: "score_type": "Fair distribution", 2026-02-13T20:15:10.407 INFO:tasks.workunit.client.0.trial030.stdout: "score_acting": 2.9900000095367432, 2026-02-13T20:15:10.407 INFO:tasks.workunit.client.0.trial030.stdout: "score_stable": 2.9900000095367432, 2026-02-13T20:15:10.407 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_score": 0.67000001668930054, 2026-02-13T20:15:10.407 INFO:tasks.workunit.client.0.trial030.stdout: "raw_score_acting": 2, 2026-02-13T20:15:10.407 INFO:tasks.workunit.client.0.trial030.stdout: "raw_score_stable": 2, 2026-02-13T20:15:10.407 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity_weighted": 1, 2026-02-13T20:15:10.407 INFO:tasks.workunit.client.0.trial030.stdout: "average_primary_affinity": 1, 2026-02-13T20:15:10.407 INFO:tasks.workunit.client.0.trial030.stdout: "average_primary_affinity_weighted": 1 2026-02-13T20:15:10.407 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.407 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.407 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:15:10.408 INFO:tasks.workunit.client.0.trial030.stdout: "osds": [ 2026-02-13T20:15:10.408 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.408 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:15:10.408 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "b6e085ae-f1ef-46b2-bb98-365b92356624", 2026-02-13T20:15:10.408 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-13T20:15:10.408 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-13T20:15:10.408 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-13T20:15:10.408 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-13T20:15:10.408 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 5, 2026-02-13T20:15:10.408 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 29, 2026-02-13T20:15:10.408 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 36, 2026-02-13T20:15:10.408 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 44, 2026-02-13T20:15:10.408 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 30, 2026-02-13T20:15:10.409 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-13T20:15:10.409 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:15:10.409 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:15:10.409 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.409 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:15:10.409 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6800", 2026-02-13T20:15:10.409 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1169190239 2026-02-13T20:15:10.409 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.409 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.409 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:15:10.409 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6801", 2026-02-13T20:15:10.409 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1169190239 2026-02-13T20:15:10.409 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.410 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.410 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.410 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-13T20:15:10.410 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:15:10.410 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.410 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:15:10.410 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6802", 2026-02-13T20:15:10.410 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1169190239 2026-02-13T20:15:10.410 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.410 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.410 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:15:10.410 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6803", 2026-02-13T20:15:10.410 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1169190239 2026-02-13T20:15:10.411 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.411 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.411 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.411 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-13T20:15:10.411 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:15:10.411 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.411 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:15:10.411 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6806", 2026-02-13T20:15:10.411 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1169190239 2026-02-13T20:15:10.411 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.411 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.411 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:15:10.411 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6807", 2026-02-13T20:15:10.412 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1169190239 2026-02-13T20:15:10.412 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.412 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.412 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.412 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-13T20:15:10.412 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:15:10.412 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.412 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:15:10.412 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6804", 2026-02-13T20:15:10.412 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1169190239 2026-02-13T20:15:10.412 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.412 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.412 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:15:10.413 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6805", 2026-02-13T20:15:10.413 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1169190239 2026-02-13T20:15:10.413 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.413 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.413 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.413 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6801/1169190239", 2026-02-13T20:15:10.413 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6803/1169190239", 2026-02-13T20:15:10.413 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6807/1169190239", 2026-02-13T20:15:10.413 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6805/1169190239", 2026-02-13T20:15:10.413 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-13T20:15:10.413 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-13T20:15:10.413 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-13T20:15:10.413 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.413 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.414 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.414 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:15:10.414 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "58e5ae01-f34d-4563-8340-e58b1e0c4c9c", 2026-02-13T20:15:10.414 INFO:tasks.workunit.client.0.trial030.stdout: "up": 0, 2026-02-13T20:15:10.414 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-13T20:15:10.414 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-13T20:15:10.414 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-13T20:15:10.414 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 0, 2026-02-13T20:15:10.414 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 0, 2026-02-13T20:15:10.414 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 10, 2026-02-13T20:15:10.414 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 21, 2026-02-13T20:15:10.414 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 31, 2026-02-13T20:15:10.414 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-13T20:15:10.414 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:15:10.414 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:15:10.415 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.415 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:15:10.415 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-13T20:15:10.415 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3416176909 2026-02-13T20:15:10.415 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.415 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.415 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:15:10.415 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-13T20:15:10.415 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3416176909 2026-02-13T20:15:10.415 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.415 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.415 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.415 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-13T20:15:10.415 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:15:10.416 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.416 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:15:10.416 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-13T20:15:10.416 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3416176909 2026-02-13T20:15:10.416 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.416 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.416 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:15:10.416 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-13T20:15:10.416 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3416176909 2026-02-13T20:15:10.416 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.416 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.416 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.416 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-13T20:15:10.416 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:15:10.416 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.417 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:15:10.417 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-13T20:15:10.417 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3416176909 2026-02-13T20:15:10.417 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.417 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.417 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:15:10.417 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-13T20:15:10.417 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3416176909 2026-02-13T20:15:10.417 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.417 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.417 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.417 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-13T20:15:10.417 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:15:10.417 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.418 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:15:10.418 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-13T20:15:10.418 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3416176909 2026-02-13T20:15:10.418 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.418 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.418 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:15:10.418 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-13T20:15:10.418 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3416176909 2026-02-13T20:15:10.418 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.418 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.418 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.418 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/3416176909", 2026-02-13T20:15:10.418 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/3416176909", 2026-02-13T20:15:10.418 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3416176909", 2026-02-13T20:15:10.419 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3416176909", 2026-02-13T20:15:10.419 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-13T20:15:10.419 INFO:tasks.workunit.client.0.trial030.stdout: "exists" 2026-02-13T20:15:10.419 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.419 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.419 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.419 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:15:10.419 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "d77b547d-75d9-49e5-86d4-8ccbd530ae28", 2026-02-13T20:15:10.419 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-13T20:15:10.419 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-13T20:15:10.419 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-13T20:15:10.419 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-13T20:15:10.419 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 14, 2026-02-13T20:15:10.419 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 29, 2026-02-13T20:15:10.420 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 38, 2026-02-13T20:15:10.420 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 0, 2026-02-13T20:15:10.420 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 32, 2026-02-13T20:15:10.420 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-13T20:15:10.420 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:15:10.420 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:15:10.420 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.420 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:15:10.420 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-13T20:15:10.420 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2057545651 2026-02-13T20:15:10.420 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.420 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.420 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:15:10.420 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-13T20:15:10.420 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2057545651 2026-02-13T20:15:10.421 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.421 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.421 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.421 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-13T20:15:10.421 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:15:10.421 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.421 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:15:10.421 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-13T20:15:10.421 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2057545651 2026-02-13T20:15:10.421 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.421 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.421 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:15:10.421 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-13T20:15:10.421 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2057545651 2026-02-13T20:15:10.421 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.421 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.421 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.422 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-13T20:15:10.422 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:15:10.422 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.422 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:15:10.422 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-13T20:15:10.422 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2057545651 2026-02-13T20:15:10.422 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.422 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.422 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:15:10.422 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-13T20:15:10.422 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2057545651 2026-02-13T20:15:10.422 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.422 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.422 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.422 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-13T20:15:10.422 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:15:10.423 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.423 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:15:10.423 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-13T20:15:10.423 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2057545651 2026-02-13T20:15:10.423 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.423 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.423 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:15:10.423 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-13T20:15:10.423 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2057545651 2026-02-13T20:15:10.423 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.423 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.423 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.423 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/2057545651", 2026-02-13T20:15:10.423 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/2057545651", 2026-02-13T20:15:10.423 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2057545651", 2026-02-13T20:15:10.423 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2057545651", 2026-02-13T20:15:10.423 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-13T20:15:10.424 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-13T20:15:10.424 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-13T20:15:10.424 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.424 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.424 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:15:10.424 INFO:tasks.workunit.client.0.trial030.stdout: "osd_xinfo": [ 2026-02-13T20:15:10.424 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.424 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:15:10.424 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-13T20:14:04.374192+0000", 2026-02-13T20:15:10.424 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-13T20:15:10.424 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-13T20:15:10.424 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-13T20:15:10.424 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-13T20:15:10.424 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-13T20:13:31.010634+0000", 2026-02-13T20:15:10.424 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-13T20:15:10.424 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.425 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.425 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:15:10.425 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-13T20:14:04.666891+0000", 2026-02-13T20:15:10.425 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-13T20:15:10.425 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-13T20:15:10.425 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-13T20:15:10.425 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-13T20:15:10.425 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-13T20:15:10.425 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-13T20:15:10.425 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.425 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.425 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:15:10.425 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-13T20:14:04.955660+0000", 2026-02-13T20:15:10.425 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-13T20:15:10.425 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-13T20:15:10.425 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-13T20:15:10.425 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-13T20:15:10.425 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-13T20:13:37.245364+0000", 2026-02-13T20:15:10.426 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-13T20:15:10.426 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.426 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:15:10.426 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap": [], 2026-02-13T20:15:10.426 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_items": [], 2026-02-13T20:15:10.426 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_primaries": [], 2026-02-13T20:15:10.426 INFO:tasks.workunit.client.0.trial030.stdout: "pg_temp": [], 2026-02-13T20:15:10.426 INFO:tasks.workunit.client.0.trial030.stdout: "primary_temp": [], 2026-02-13T20:15:10.426 INFO:tasks.workunit.client.0.trial030.stdout: "blocklist": {}, 2026-02-13T20:15:10.426 INFO:tasks.workunit.client.0.trial030.stdout: "range_blocklist": {}, 2026-02-13T20:15:10.426 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profiles": { 2026-02-13T20:15:10.426 INFO:tasks.workunit.client.0.trial030.stdout: "default": { 2026-02-13T20:15:10.426 INFO:tasks.workunit.client.0.trial030.stdout: "k": "2", 2026-02-13T20:15:10.426 INFO:tasks.workunit.client.0.trial030.stdout: "m": "2", 2026-02-13T20:15:10.426 INFO:tasks.workunit.client.0.trial030.stdout: "plugin": "isa", 2026-02-13T20:15:10.426 INFO:tasks.workunit.client.0.trial030.stdout: "technique": "reed_sol_van" 2026-02-13T20:15:10.426 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.426 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.426 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps_queue": [], 2026-02-13T20:15:10.427 INFO:tasks.workunit.client.0.trial030.stdout: "new_removed_snaps": [], 2026-02-13T20:15:10.427 INFO:tasks.workunit.client.0.trial030.stdout: "new_purged_snaps": [], 2026-02-13T20:15:10.427 INFO:tasks.workunit.client.0.trial030.stdout: "crush_node_flags": {}, 2026-02-13T20:15:10.427 INFO:tasks.workunit.client.0.trial030.stdout: "device_class_flags": {}, 2026-02-13T20:15:10.427 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": { 2026-02-13T20:15:10.427 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_enabled": false, 2026-02-13T20:15:10.427 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_bucket_count": 0, 2026-02-13T20:15:10.427 INFO:tasks.workunit.client.0.trial030.stdout: "degraded_stretch_mode": 0, 2026-02-13T20:15:10.427 INFO:tasks.workunit.client.0.trial030.stdout: "recovering_stretch_mode": 0, 2026-02-13T20:15:10.427 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_bucket": 0 2026-02-13T20:15:10.427 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.427 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.427 INFO:tasks.workunit.client.0.trial030.stdout: "osd_metadata": [ 2026-02-13T20:15:10.427 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.427 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:15:10.427 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-13T20:15:10.427 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6802/1169190239,v1:127.0.0.1:6803/1169190239]", 2026-02-13T20:15:10.427 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-13T20:15:10.427 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-13T20:15:10.428 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-13T20:15:10.428 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T20:15:10.428 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-13T20:15:10.428 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T20:15:10.428 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-13T20:15:10.428 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T20:15:10.428 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T20:15:10.428 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T20:15:10.428 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T20:15:10.428 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T20:15:10.428 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-13T20:15:10.428 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T20:15:10.428 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T20:15:10.428 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T20:15:10.428 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T20:15:10.428 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T20:15:10.428 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T20:15:10.428 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-13T20:15:10.428 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-13T20:15:10.428 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:15:10.429 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-13T20:15:10.429 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:15:10.429 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T20:15:10.429 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-13T20:13:28.365182Z", 2026-02-13T20:15:10.429 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-13T20:15:10.429 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-13T20:15:10.429 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T20:15:10.429 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-13T20:15:10.429 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-13T20:15:10.429 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T20:15:10.429 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-13T20:15:10.429 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6800/1169190239,v1:127.0.0.1:6801/1169190239]", 2026-02-13T20:15:10.429 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-13T20:15:10.429 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/1169190239,v1:127.0.0.1:6807/1169190239]", 2026-02-13T20:15:10.429 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/1169190239,v1:127.0.0.1:6805/1169190239]", 2026-02-13T20:15:10.429 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-13T20:15:10.429 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-13T20:15:10.429 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T20:15:10.429 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T20:15:10.430 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-13T20:15:10.430 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961704", 2026-02-13T20:15:10.430 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T20:15:10.430 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-13T20:15:10.430 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-13T20:15:10.430 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-13T20:15:10.430 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/0", 2026-02-13T20:15:10.430 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-13T20:15:10.430 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-13T20:15:10.430 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-13T20:15:10.430 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.430 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.430 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:15:10.430 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-13T20:15:10.430 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/3416176909,v1:127.0.0.1:6813/3416176909]", 2026-02-13T20:15:10.430 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-13T20:15:10.430 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-13T20:15:10.430 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-13T20:15:10.430 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T20:15:10.430 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-13T20:15:10.430 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T20:15:10.431 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-13T20:15:10.431 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T20:15:10.431 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T20:15:10.431 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T20:15:10.431 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T20:15:10.431 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T20:15:10.431 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-13T20:15:10.431 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T20:15:10.431 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T20:15:10.431 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T20:15:10.431 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T20:15:10.431 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T20:15:10.431 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T20:15:10.431 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-13T20:15:10.431 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-13T20:15:10.431 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:15:10.431 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-13T20:15:10.431 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:15:10.431 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T20:15:10.431 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-13T20:13:31.960202Z", 2026-02-13T20:15:10.431 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-13T20:15:10.431 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-13T20:15:10.432 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T20:15:10.432 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-13T20:15:10.432 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-13T20:15:10.432 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T20:15:10.432 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-13T20:15:10.432 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/3416176909,v1:127.0.0.1:6811/3416176909]", 2026-02-13T20:15:10.432 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-13T20:15:10.432 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3416176909,v1:127.0.0.1:6817/3416176909]", 2026-02-13T20:15:10.432 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3416176909,v1:127.0.0.1:6815/3416176909]", 2026-02-13T20:15:10.432 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-13T20:15:10.432 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-13T20:15:10.432 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T20:15:10.432 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T20:15:10.432 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-13T20:15:10.432 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961704", 2026-02-13T20:15:10.432 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T20:15:10.432 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-13T20:15:10.432 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-13T20:15:10.432 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-13T20:15:10.432 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/1", 2026-02-13T20:15:10.432 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-13T20:15:10.433 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-13T20:15:10.433 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-13T20:15:10.433 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.433 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.433 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:15:10.433 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-13T20:15:10.433 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/2057545651,v1:127.0.0.1:6813/2057545651]", 2026-02-13T20:15:10.433 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-13T20:15:10.433 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-13T20:15:10.433 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-13T20:15:10.433 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T20:15:10.433 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-13T20:15:10.433 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T20:15:10.433 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-13T20:15:10.433 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T20:15:10.433 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T20:15:10.433 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T20:15:10.433 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T20:15:10.433 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T20:15:10.433 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-13T20:15:10.433 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T20:15:10.434 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T20:15:10.434 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T20:15:10.434 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T20:15:10.434 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T20:15:10.434 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T20:15:10.434 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-13T20:15:10.434 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-13T20:15:10.434 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:15:10.434 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-13T20:15:10.434 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:15:10.434 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T20:15:10.434 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-13T20:13:34.819765Z", 2026-02-13T20:15:10.434 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-13T20:15:10.434 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-13T20:15:10.434 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T20:15:10.434 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-13T20:15:10.434 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-13T20:15:10.434 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T20:15:10.434 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-13T20:15:10.434 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/2057545651,v1:127.0.0.1:6811/2057545651]", 2026-02-13T20:15:10.434 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2057545651,v1:127.0.0.1:6817/2057545651]", 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2057545651,v1:127.0.0.1:6815/2057545651]", 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961704", 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/2", 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_clean_epochs": { 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: "min_last_epoch_clean": 0, 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": { 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: "per_pool": [] 2026-02-13T20:15:10.435 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: "osd_epochs": [ 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 36 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 39 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_first_committed": 1, 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_last_committed": 45, 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: "crushmap": { 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: "devices": [ 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.0", 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:15:10.436 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.1", 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.2", 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: "types": [ 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 0, 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd" 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: "name": "host" 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 2, 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: "name": "chassis" 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 3, 2026-02-13T20:15:10.437 INFO:tasks.workunit.client.0.trial030.stdout: "name": "rack" 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 4, 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: "name": "row" 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 5, 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pdu" 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 6, 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pod" 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 7, 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: "name": "room" 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 8, 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: "name": "datacenter" 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 9, 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: "name": "zone" 2026-02-13T20:15:10.438 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.439 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.439 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 10, 2026-02-13T20:15:10.439 INFO:tasks.workunit.client.0.trial030.stderr:report 2923679646 2026-02-13T20:15:10.439 INFO:tasks.workunit.client.0.trial030.stdout: "name": "region" 2026-02-13T20:15:10.439 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.439 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.439 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-13T20:15:10.439 INFO:tasks.workunit.client.0.trial030.stdout: "name": "root" 2026-02-13T20:15:10.439 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.439 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:15:10.439 INFO:tasks.workunit.client.0.trial030.stdout: "buckets": [ 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: "id": -1, 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default", 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: "id": -2, 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default~ssd", 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:15:10.440 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030", 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:15:10.441 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030~ssd", 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:15:10.442 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: "rules": [ 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: "rule_id": 0, 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: "rule_name": "replicated_rule", 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: "steps": [ 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: "op": "take", 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: "item": -1, 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: "item_name": "default" 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: "op": "choose_firstn", 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: "num": 0, 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: "type": "osd" 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: "op": "emit" 2026-02-13T20:15:10.443 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "tunables": { 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_tries": 0, 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_fallback_tries": 0, 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "choose_total_tries": 50, 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_descend_once": 1, 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_vary_r": 1, 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_stable": 1, 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "msr_descents": 100, 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "msr_collision_tries": 100, 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "straw_calc_version": 1, 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "allowed_bucket_algs": 54, 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "profile": "jewel", 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_tunables": 1, 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "legacy_tunables": 0, 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "minimum_required_version": "jewel", 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables": 1, 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables2": 1, 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "has_v2_rules": 0, 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables3": 1, 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "has_v3_rules": 0, 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "has_v4_buckets": 1, 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables5": 1, 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "has_v5_rules": 0, 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "has_msr_rules": 0 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.444 INFO:tasks.workunit.client.0.trial030.stdout: "choose_args": {} 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "fsmap": { 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "btime": "2026-02-13T20:13:27:394010+0000", 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "default_fscid": -1, 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "compat": { 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "compat": {}, 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "ro_compat": {}, 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "incompat": { 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "feature_1": "base v0.20", 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "feature_2": "client writeable ranges", 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "feature_3": "default file layouts on dirs", 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "feature_4": "dir inode in separate object", 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "feature_5": "mds uses versioned encoding", 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "feature_8": "no anchor table", 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "feature_9": "file layout v2", 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "feature_10": "snaprealm v2", 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "feature_11": "minor log segments", 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "feature_12": "quiesce subvolumes" 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "feature_flags": { 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "enable_multiple": true, 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "ever_enabled_multiple": true 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "standbys": [], 2026-02-13T20:15:10.445 INFO:tasks.workunit.client.0.trial030.stdout: "filesystems": [] 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_first_committed": 1, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_last_committed": 1, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "auth": { 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 5, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "num_secrets": 3 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 32, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_active": 32, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_unknown": 0, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "num_osd": 3, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "pool_sum": { 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 51688, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 100, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 0, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 300, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 100, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 100, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 101, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 101, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-13T20:15:10.446 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:15:10.447 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 513, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 513, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "up": 64, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 64, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 0 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum": { 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 65, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83952, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2168, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 28, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81699, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488848, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036580352, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2220032, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 457113, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:15:10.448 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 29315, 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83660157 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum_by_class": { 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "ssd": { 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 65, 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-13T20:15:10.449 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83952, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2168, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 28, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81699, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488848, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036580352, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2220032, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 457113, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 29315, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83660157 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.450 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "pool_stats": [ 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": 1, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 32, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 51688, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 100, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 0, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 300, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 100, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 100, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 101, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 101, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T20:15:10.451 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 1220608, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 154528, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 513, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 513, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "up": 64, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 64, 2026-02-13T20:15:10.452 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 3 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: "osd_stats": [ 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 154618822673 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 42949672972 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 163208757265 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_state": [ 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: "state": "active+undersized+degraded", 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: "num": 32 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: "pool_pg_unavailable_map": [ 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": "1", 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: "pgs": [] 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_osd": [ 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-13T20:15:10.453 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 32, 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 32, 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 32, 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 0, 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": [ 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": {} 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "servicemap": { 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 5, 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-13T20:15:09.821543+0000", 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "services": {} 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_first_committed": 1, 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_last_committed": 52, 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "logm_first_committed": 1, 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "logm_last_committed": 281, 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "paxos": { 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-13T20:15:10.454 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 389, 2026-02-13T20:15:10.455 INFO:tasks.workunit.client.0.trial030.stdout: "last_pn": 0, 2026-02-13T20:15:10.455 INFO:tasks.workunit.client.0.trial030.stdout: "accepted_pn": 0 2026-02-13T20:15:10.455 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:15:10.455 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-13T20:15:10.455 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-13T20:15:10.455 INFO:tasks.workunit.client.0.trial030.stdout:delay recovery 2026-02-13T20:15:10.455 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:763: TEST_divergent_3: echo 'delay recovery' 2026-02-13T20:15:10.455 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:764: TEST_divergent_3: ceph pg dump pgs 2026-02-13T20:15:10.614 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:15:10.614 INFO:tasks.workunit.client.0.trial030.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994145+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.614 INFO:tasks.workunit.client.0.trial030.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991961+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.614 INFO:tasks.workunit.client.0.trial030.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991399+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.614 INFO:tasks.workunit.client.0.trial030.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.993586+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992275+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992208+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992179+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994740+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.993520+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.993680+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994131+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994158+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992293+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992500+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992453+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991699+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:41.697400+0000 29'100 45:146 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 user requested scrub scheduled @ 2026-02-13T20:15:34.784033+0000 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992123+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-13T20:14:31.994209+0000 45'101 45:146 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994489+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.990898+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991446+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991576+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992220+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991936+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991795+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991811+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994164+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991374+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991490+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991085+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992012+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:15:10.615 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:15:10.616 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:15:10.625 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: for i in $non_divergent 2026-02-13T20:15:10.625 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: get_asok_path osd.0 2026-02-13T20:15:10.626 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T20:15:10.626 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T20:15:10.626 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:15:10.626 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:15:10.626 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:15:10.626 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.0.asok 2026-02-13T20:15:10.627 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: CEPH_ARGS= 2026-02-13T20:15:10.627 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.0.asok set_recovery_delay 100000 2026-02-13T20:15:10.694 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T20:15:10.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: for i in $non_divergent 2026-02-13T20:15:10.700 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: get_asok_path osd.2 2026-02-13T20:15:10.700 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-13T20:15:10.700 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-13T20:15:10.701 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:15:10.701 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:15:10.701 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:15:10.703 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.2.asok 2026-02-13T20:15:10.704 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: CEPH_ARGS= 2026-02-13T20:15:10.704 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.2.asok set_recovery_delay 100000 2026-02-13T20:15:10.756 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T20:15:10.762 INFO:tasks.workunit.client.0.trial030.stdout:revive divergent 1 2026-02-13T20:15:10.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:771: TEST_divergent_3: echo 'revive divergent 1' 2026-02-13T20:15:10.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:772: TEST_divergent_3: ceph pg dump pgs 2026-02-13T20:15:10.980 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:15:10.980 INFO:tasks.workunit.client.0.trial030.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994145+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.980 INFO:tasks.workunit.client.0.trial030.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991961+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.980 INFO:tasks.workunit.client.0.trial030.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991399+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.981 INFO:tasks.workunit.client.0.trial030.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.993586+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.981 INFO:tasks.workunit.client.0.trial030.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992275+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.981 INFO:tasks.workunit.client.0.trial030.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992208+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.981 INFO:tasks.workunit.client.0.trial030.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992179+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.981 INFO:tasks.workunit.client.0.trial030.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994740+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.981 INFO:tasks.workunit.client.0.trial030.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.993520+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.981 INFO:tasks.workunit.client.0.trial030.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.993680+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.981 INFO:tasks.workunit.client.0.trial030.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994131+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.981 INFO:tasks.workunit.client.0.trial030.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994158+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.981 INFO:tasks.workunit.client.0.trial030.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992293+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.981 INFO:tasks.workunit.client.0.trial030.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992500+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.981 INFO:tasks.workunit.client.0.trial030.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992453+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.982 INFO:tasks.workunit.client.0.trial030.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991699+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.982 INFO:tasks.workunit.client.0.trial030.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:41.697400+0000 29'100 45:146 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 user requested scrub scheduled @ 2026-02-13T20:15:34.784033+0000 0 0 2026-02-13T20:15:10.982 INFO:tasks.workunit.client.0.trial030.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992123+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.982 INFO:tasks.workunit.client.0.trial030.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-13T20:14:31.994209+0000 45'101 45:146 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.982 INFO:tasks.workunit.client.0.trial030.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994489+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.982 INFO:tasks.workunit.client.0.trial030.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.990898+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.982 INFO:tasks.workunit.client.0.trial030.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991446+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.982 INFO:tasks.workunit.client.0.trial030.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991576+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.982 INFO:tasks.workunit.client.0.trial030.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992220+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.983 INFO:tasks.workunit.client.0.trial030.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991936+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.983 INFO:tasks.workunit.client.0.trial030.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991795+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.983 INFO:tasks.workunit.client.0.trial030.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991811+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.983 INFO:tasks.workunit.client.0.trial030.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994164+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.983 INFO:tasks.workunit.client.0.trial030.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991374+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.983 INFO:tasks.workunit.client.0.trial030.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991490+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.983 INFO:tasks.workunit.client.0.trial030.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991085+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.983 INFO:tasks.workunit.client.0.trial030.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992012+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:10.983 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:15:10.983 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:15:10.984 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:15:10.990 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:773: TEST_divergent_3: ceph osd set noup 2026-02-13T20:15:11.303 INFO:tasks.workunit.client.0.trial030.stderr:noup is set 2026-02-13T20:15:11.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:774: TEST_divergent_3: activate_osd td/divergent-priors 1 2026-02-13T20:15:11.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T20:15:11.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T20:15:11.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T20:15:11.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T20:15:11.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-13T20:15:11.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:15:11.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:15:11.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:15:11.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:15:11.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T20:15:11.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T20:15:11.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T20:15:11.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T20:15:11.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:15:11.318 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T20:15:11.319 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:15:11.319 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:15:11.319 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:15:11.319 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:15:11.319 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:15:11.319 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:15:11.319 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:15:11.319 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:15:11.319 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:15:11.319 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:15:11.319 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:15:11.320 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:15:11.320 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:15:11.320 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:15:11.320 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T20:15:11.320 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T20:15:11.320 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-13T20:15:11.321 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-13T20:15:11.322 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T20:15:11.322 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:15:11.322 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-13T20:15:11.322 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T20:15:11.322 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T20:15:11.322 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T20:15:11.322 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T20:15:11.344 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:11.341+0000 7fdc6dd06a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:11.346 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:11.341+0000 7fdc6dd06a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:11.347 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:11.341+0000 7fdc6dd06a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:11.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-13T20:15:11.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:775: TEST_divergent_3: sleep 5 2026-02-13T20:15:11.721 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:11.717+0000 7fdc6dd06a40 -1 Falling back to public interface 2026-02-13T20:15:12.337 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:12.333+0000 7fdc6dd06a40 -1 osd.1 29 log_to_monitors true 2026-02-13T20:15:16.537 INFO:tasks.workunit.client.0.trial030.stdout:delay recovery divergent 2026-02-13T20:15:16.537 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:777: TEST_divergent_3: echo 'delay recovery divergent' 2026-02-13T20:15:16.537 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:778: TEST_divergent_3: ceph pg dump pgs 2026-02-13T20:15:16.737 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:15:16.737 INFO:tasks.workunit.client.0.trial030.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994145+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:16.737 INFO:tasks.workunit.client.0.trial030.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991961+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:16.738 INFO:tasks.workunit.client.0.trial030.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991399+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 user requested scrub scheduled @ 2026-02-13T20:15:43.763099+0000 0 0 2026-02-13T20:15:16.738 INFO:tasks.workunit.client.0.trial030.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.993586+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:16.738 INFO:tasks.workunit.client.0.trial030.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992275+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:16.738 INFO:tasks.workunit.client.0.trial030.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992208+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:16.738 INFO:tasks.workunit.client.0.trial030.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992179+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:16.738 INFO:tasks.workunit.client.0.trial030.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994740+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:16.738 INFO:tasks.workunit.client.0.trial030.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.993520+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:16.738 INFO:tasks.workunit.client.0.trial030.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.993680+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:16.738 INFO:tasks.workunit.client.0.trial030.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994131+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:16.738 INFO:tasks.workunit.client.0.trial030.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994158+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:16.738 INFO:tasks.workunit.client.0.trial030.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992293+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:16.738 INFO:tasks.workunit.client.0.trial030.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992500+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:16.739 INFO:tasks.workunit.client.0.trial030.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992453+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:16.739 INFO:tasks.workunit.client.0.trial030.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991699+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 user requested scrub scheduled @ 2026-02-13T20:15:58.580183+0000 0 0 2026-02-13T20:15:16.739 INFO:tasks.workunit.client.0.trial030.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:41.697400+0000 29'100 46:148 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 user requested scrub scheduled @ 2026-02-13T20:15:34.784033+0000 0 0 2026-02-13T20:15:16.739 INFO:tasks.workunit.client.0.trial030.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992123+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 user requested scrub scheduled @ 2026-02-13T20:16:01.615692+0000 0 0 2026-02-13T20:15:16.739 INFO:tasks.workunit.client.0.trial030.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-13T20:14:31.994209+0000 45'101 46:148 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:16.739 INFO:tasks.workunit.client.0.trial030.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994489+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:16.739 INFO:tasks.workunit.client.0.trial030.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.990898+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 user requested scrub scheduled @ 2026-02-13T20:15:37.729765+0000 0 0 2026-02-13T20:15:16.739 INFO:tasks.workunit.client.0.trial030.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991446+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:16.739 INFO:tasks.workunit.client.0.trial030.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991576+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 user requested scrub scheduled @ 2026-02-13T20:16:07.595264+0000 0 0 2026-02-13T20:15:16.739 INFO:tasks.workunit.client.0.trial030.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992220+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:16.739 INFO:tasks.workunit.client.0.trial030.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991936+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:16.739 INFO:tasks.workunit.client.0.trial030.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991795+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 user requested scrub scheduled @ 2026-02-13T20:15:59.615130+0000 0 0 2026-02-13T20:15:16.740 INFO:tasks.workunit.client.0.trial030.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991811+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 user requested scrub scheduled @ 2026-02-13T20:15:49.709853+0000 0 0 2026-02-13T20:15:16.740 INFO:tasks.workunit.client.0.trial030.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.994164+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:16.740 INFO:tasks.workunit.client.0.trial030.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991374+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 user requested scrub scheduled @ 2026-02-13T20:15:42.746972+0000 0 0 2026-02-13T20:15:16.740 INFO:tasks.workunit.client.0.trial030.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991490+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:16.740 INFO:tasks.workunit.client.0.trial030.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.991085+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 user requested scrub scheduled @ 2026-02-13T20:15:38.743054+0000 0 0 2026-02-13T20:15:16.740 INFO:tasks.workunit.client.0.trial030.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:14:31.992012+0000 29'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 user requested scrub scheduled @ 2026-02-13T20:16:03.629085+0000 0 0 2026-02-13T20:15:16.740 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:15:16.740 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:15:16.740 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:15:16.748 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: get_asok_path osd.1 2026-02-13T20:15:16.749 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T20:15:16.749 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T20:15:16.749 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:15:16.749 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:15:16.749 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:15:16.749 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.1.asok 2026-02-13T20:15:16.750 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: CEPH_ARGS= 2026-02-13T20:15:16.750 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.1.asok set_recovery_delay 100000 2026-02-13T20:15:16.813 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T20:15:16.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:781: TEST_divergent_3: ceph osd unset noup 2026-02-13T20:15:17.141 INFO:tasks.workunit.client.0.trial030.stderr:noup is unset 2026-02-13T20:15:17.157 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:783: TEST_divergent_3: wait_for_osd up 0 2026-02-13T20:15:17.157 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:15:17.157 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T20:15:17.157 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:15:17.157 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:15:17.157 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:15:17.158 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:15:17.158 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:15:17.158 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:15:17.158 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:15:17.388 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 36 up_thru 44 down_at 30 last_clean_interval [5,29) [v2:127.0.0.1:6800/1169190239,v1:127.0.0.1:6801/1169190239] [v2:127.0.0.1:6802/1169190239,v1:127.0.0.1:6803/1169190239] exists,up b6e085ae-f1ef-46b2-bb98-365b92356624 2026-02-13T20:15:17.388 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:15:17.389 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:15:17.389 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:15:17.389 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:784: TEST_divergent_3: wait_for_osd up 1 2026-02-13T20:15:17.389 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:15:17.389 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T20:15:17.389 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:15:17.389 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:15:17.389 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:15:17.389 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:15:17.389 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:15:17.389 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:15:17.389 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:15:17.603 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 50 up_thru 50 down_at 31 last_clean_interval [10,29) [v2:127.0.0.1:6818/4101757710,v1:127.0.0.1:6819/4101757710] [v2:127.0.0.1:6820/4101757710,v1:127.0.0.1:6821/4101757710] exists,up 58e5ae01-f34d-4563-8340-e58b1e0c4c9c 2026-02-13T20:15:17.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:15:17.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:15:17.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:15:17.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:785: TEST_divergent_3: wait_for_osd up 2 2026-02-13T20:15:17.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:15:17.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T20:15:17.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:15:17.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:15:17.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:15:17.606 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:15:17.606 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:15:17.606 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:15:17.607 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:15:17.821 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 38 up_thru 0 down_at 32 last_clean_interval [14,29) [v2:127.0.0.1:6810/2057545651,v1:127.0.0.1:6811/2057545651] [v2:127.0.0.1:6812/2057545651,v1:127.0.0.1:6813/2057545651] exists,up d77b547d-75d9-49e5-86d4-8ccbd530ae28 2026-02-13T20:15:17.822 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:15:17.822 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:15:17.822 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:15:17.822 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:787: TEST_divergent_3: ceph pg dump pgs 2026-02-13T20:15:18.032 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:15:18.032 INFO:tasks.workunit.client.0.trial030.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.260209+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.032 INFO:tasks.workunit.client.0.trial030.stdout:1.1e 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.260127+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.032 INFO:tasks.workunit.client.0.trial030.stdout:1.1d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.257987+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.032 INFO:tasks.workunit.client.0.trial030.stdout:1.b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.255282+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.032 INFO:tasks.workunit.client.0.trial030.stdout:1.a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.257843+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.032 INFO:tasks.workunit.client.0.trial030.stdout:1.9 3 1 1 0 0 1600 0 0 11 89 11 active+recovery_wait+degraded 2026-02-13T20:15:17.258673+0000 29'100 51:141 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:15:18.032 INFO:tasks.workunit.client.0.trial030.stdout:1.8 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.253603+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.033 INFO:tasks.workunit.client.0.trial030.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.257413+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.033 INFO:tasks.workunit.client.0.trial030.stdout:1.6 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.257947+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.033 INFO:tasks.workunit.client.0.trial030.stdout:1.5 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.254186+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.033 INFO:tasks.workunit.client.0.trial030.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.259134+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.033 INFO:tasks.workunit.client.0.trial030.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.253996+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.033 INFO:tasks.workunit.client.0.trial030.stdout:1.2 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.257339+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.033 INFO:tasks.workunit.client.0.trial030.stdout:1.c 3 0 0 0 0 1600 0 0 14 86 14 active+clean 2026-02-13T20:15:17.257377+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.033 INFO:tasks.workunit.client.0.trial030.stdout:1.1 4 0 0 0 0 1600 0 0 15 85 15 active+clean 2026-02-13T20:15:17.257661+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.033 INFO:tasks.workunit.client.0.trial030.stdout:1.1c 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.260188+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.033 INFO:tasks.workunit.client.0.trial030.stdout:1.0 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.253786+0000 29'100 51:143 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.033 INFO:tasks.workunit.client.0.trial030.stdout:1.d 3 0 0 0 0 1600 0 0 12 88 12 active+clean 2026-02-13T20:15:17.253840+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.034 INFO:tasks.workunit.client.0.trial030.stdout:1.e 3 1 1 0 0 2088 0 0 14 87 14 active+recovering+degraded 2026-02-13T20:15:17.260367+0000 45'101 51:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:15:18.034 INFO:tasks.workunit.client.0.trial030.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.260156+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.034 INFO:tasks.workunit.client.0.trial030.stdout:1.10 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.257486+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.034 INFO:tasks.workunit.client.0.trial030.stdout:1.11 3 1 1 0 0 1600 0 0 16 84 16 active+recovery_wait+degraded 2026-02-13T20:15:17.258988+0000 29'100 51:141 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:15:18.034 INFO:tasks.workunit.client.0.trial030.stdout:1.12 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.260122+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.034 INFO:tasks.workunit.client.0.trial030.stdout:1.13 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.258756+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.034 INFO:tasks.workunit.client.0.trial030.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.260191+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.034 INFO:tasks.workunit.client.0.trial030.stdout:1.15 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.256811+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.034 INFO:tasks.workunit.client.0.trial030.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.259002+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.034 INFO:tasks.workunit.client.0.trial030.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.258986+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.034 INFO:tasks.workunit.client.0.trial030.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.255270+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.034 INFO:tasks.workunit.client.0.trial030.stdout:1.19 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.260005+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.035 INFO:tasks.workunit.client.0.trial030.stdout:1.1a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.259047+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.035 INFO:tasks.workunit.client.0.trial030.stdout:1.1b 3 1 1 0 0 1600 0 0 10 90 10 active+recovery_wait+degraded 2026-02-13T20:15:17.258618+0000 29'100 51:141 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:15:18.035 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:15:18.035 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:15:18.035 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:15:18.040 INFO:tasks.workunit.client.0.trial030.stdout:wait for peering 2026-02-13T20:15:18.041 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:788: TEST_divergent_3: echo 'wait for peering' 2026-02-13T20:15:18.041 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:789: TEST_divergent_3: ceph pg dump pgs 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.260209+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.1e 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.260127+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.1d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.257987+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.255282+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.257843+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.9 3 1 1 0 0 1600 0 0 11 89 11 active+recovery_wait+degraded 2026-02-13T20:15:17.258673+0000 29'100 51:141 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.8 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.253603+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.257413+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.6 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.257947+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.5 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.254186+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.259134+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.253996+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.2 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.257339+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.c 3 0 0 0 0 1600 0 0 14 86 14 active+clean 2026-02-13T20:15:17.257377+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.1 4 0 0 0 0 1600 0 0 15 85 15 active+clean 2026-02-13T20:15:17.257661+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.1c 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.260188+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.0 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.253786+0000 29'100 51:143 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.d 3 0 0 0 0 1600 0 0 12 88 12 active+clean 2026-02-13T20:15:17.253840+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.e 3 1 1 0 0 2088 0 0 14 87 14 active+recovering+degraded 2026-02-13T20:15:17.260367+0000 45'101 51:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.260156+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.10 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.257486+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.11 3 1 1 0 0 1600 0 0 16 84 16 active+recovery_wait+degraded 2026-02-13T20:15:17.258988+0000 29'100 51:141 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:15:18.246 INFO:tasks.workunit.client.0.trial030.stdout:1.12 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.260122+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.247 INFO:tasks.workunit.client.0.trial030.stdout:1.13 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.258756+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.247 INFO:tasks.workunit.client.0.trial030.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.260191+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.247 INFO:tasks.workunit.client.0.trial030.stdout:1.15 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.256811+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.247 INFO:tasks.workunit.client.0.trial030.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.259002+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.247 INFO:tasks.workunit.client.0.trial030.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.258986+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.247 INFO:tasks.workunit.client.0.trial030.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.255270+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.247 INFO:tasks.workunit.client.0.trial030.stdout:1.19 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.260005+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.247 INFO:tasks.workunit.client.0.trial030.stdout:1.1a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.259047+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.247 INFO:tasks.workunit.client.0.trial030.stdout:1.1b 3 1 1 0 0 1600 0 0 10 90 10 active+recovery_wait+degraded 2026-02-13T20:15:17.258618+0000 29'100 51:141 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:15:18.247 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:15:18.247 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:15:18.247 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:15:18.254 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:790: TEST_divergent_3: rados -p test put foo /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:15:18.288 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:791: TEST_divergent_3: rm -f /tmp/tmp.nM2qNSe2Bm 2026-02-13T20:15:18.289 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:792: TEST_divergent_3: rm -f /tmp/tmp.NbbgnxSrsZ 2026-02-13T20:15:18.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:796: TEST_divergent_3: echo 'killing divergent 1' 2026-02-13T20:15:18.290 INFO:tasks.workunit.client.0.trial030.stdout:killing divergent 1 2026-02-13T20:15:18.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:797: TEST_divergent_3: ceph pg dump pgs 2026-02-13T20:15:18.502 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:15:18.502 INFO:tasks.workunit.client.0.trial030.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.260209+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.502 INFO:tasks.workunit.client.0.trial030.stdout:1.1e 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.260127+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.502 INFO:tasks.workunit.client.0.trial030.stdout:1.1d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.257987+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.502 INFO:tasks.workunit.client.0.trial030.stdout:1.b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.255282+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.502 INFO:tasks.workunit.client.0.trial030.stdout:1.a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.257843+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.503 INFO:tasks.workunit.client.0.trial030.stdout:1.9 3 1 1 0 0 1600 0 0 11 89 11 active+recovery_wait+degraded 2026-02-13T20:15:17.258673+0000 29'100 51:141 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:15:18.503 INFO:tasks.workunit.client.0.trial030.stdout:1.8 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.253603+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.503 INFO:tasks.workunit.client.0.trial030.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.257413+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.503 INFO:tasks.workunit.client.0.trial030.stdout:1.6 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.257947+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.503 INFO:tasks.workunit.client.0.trial030.stdout:1.5 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.254186+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.503 INFO:tasks.workunit.client.0.trial030.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.259134+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.503 INFO:tasks.workunit.client.0.trial030.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.253996+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.503 INFO:tasks.workunit.client.0.trial030.stdout:1.2 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.257339+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.503 INFO:tasks.workunit.client.0.trial030.stdout:1.c 3 0 0 0 0 1600 0 0 14 86 14 active+clean 2026-02-13T20:15:17.257377+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.503 INFO:tasks.workunit.client.0.trial030.stdout:1.1 4 0 0 0 0 1600 0 0 15 85 15 active+clean 2026-02-13T20:15:17.257661+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.503 INFO:tasks.workunit.client.0.trial030.stdout:1.1c 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.260188+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.503 INFO:tasks.workunit.client.0.trial030.stdout:1.0 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.253786+0000 29'100 51:143 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.504 INFO:tasks.workunit.client.0.trial030.stdout:1.d 3 0 0 0 0 1600 0 0 12 88 12 active+clean 2026-02-13T20:15:17.253840+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.504 INFO:tasks.workunit.client.0.trial030.stdout:1.e 3 1 1 0 0 2088 0 0 14 87 14 active+recovering+degraded 2026-02-13T20:15:17.260367+0000 45'101 51:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:15:18.504 INFO:tasks.workunit.client.0.trial030.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.260156+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.504 INFO:tasks.workunit.client.0.trial030.stdout:1.10 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.257486+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.504 INFO:tasks.workunit.client.0.trial030.stdout:1.11 3 1 1 0 0 1600 0 0 16 84 16 active+recovery_wait+degraded 2026-02-13T20:15:17.258988+0000 29'100 51:141 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:15:18.504 INFO:tasks.workunit.client.0.trial030.stdout:1.12 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.260122+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.504 INFO:tasks.workunit.client.0.trial030.stdout:1.13 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.258756+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.504 INFO:tasks.workunit.client.0.trial030.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.260191+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.504 INFO:tasks.workunit.client.0.trial030.stdout:1.15 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.256811+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.504 INFO:tasks.workunit.client.0.trial030.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.259002+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.504 INFO:tasks.workunit.client.0.trial030.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.258986+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.505 INFO:tasks.workunit.client.0.trial030.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.255270+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.505 INFO:tasks.workunit.client.0.trial030.stdout:1.19 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.260005+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.505 INFO:tasks.workunit.client.0.trial030.stdout:1.1a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.259047+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:18.505 INFO:tasks.workunit.client.0.trial030.stdout:1.1b 3 1 1 0 0 1600 0 0 10 90 10 active+recovery_wait+degraded 2026-02-13T20:15:17.258618+0000 29'100 51:141 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:15:18.505 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:15:18.505 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:15:18.505 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:15:18.510 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:798: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd.1 2026-02-13T20:15:18.511 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:15:18.511 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:15:18.511 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:15:18.511 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:15:18.512 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:15:18.619 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:15:18.620 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:801: TEST_divergent_3: expfile=td/divergent-priors/exp.19555.out 2026-02-13T20:15:18.620 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:802: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.19555.out 2026-02-13T20:15:18.620 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-13T20:15:18.620 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T20:15:18.620 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-13T20:15:18.620 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T20:15:18.620 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-13T20:15:18.620 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.19555.out 2026-02-13T20:15:18.800 INFO:tasks.workunit.client.0.trial030.stderr:Exporting 1.0 info 1.0( v 29'100 (29'90,29'100] local-lis/les=50/51 n=3 ec=21/21 lis/c=50/50 les/c/f=51/51/0 sis=50) 2026-02-13T20:15:18.800 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:023dd3d2:::existing_12:head# 2026-02-13T20:15:18.801 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:04c40a0c:::existing_93:head# 2026-02-13T20:15:18.801 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:064ff5fb:::existing_36:head# 2026-02-13T20:15:18.801 INFO:tasks.workunit.client.0.trial030.stderr:Export successful 2026-02-13T20:15:18.801 INFO:tasks.workunit.client.0.trial030.stdout: marking collection for removal 2026-02-13T20:15:18.801 INFO:tasks.workunit.client.0.trial030.stdout:setting '_remove' omap key 2026-02-13T20:15:18.801 INFO:tasks.workunit.client.0.trial030.stdout:finish_remove_pgs 1.0_head removing 1.0 2026-02-13T20:15:18.801 INFO:tasks.workunit.client.0.trial030.stderr:Remove successful 2026-02-13T20:15:18.896 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:803: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.19555.out 2026-02-13T20:15:18.896 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-13T20:15:18.896 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T20:15:18.896 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-13T20:15:18.896 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T20:15:18.896 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-13T20:15:18.896 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.19555.out 2026-02-13T20:15:19.059 INFO:tasks.workunit.client.0.trial030.stdout:get_pg_num_history pg_num_history pg_num_history(e52 pg_nums {1={21=1,44=32}} deleted_pools ) 2026-02-13T20:15:19.060 INFO:tasks.workunit.client.0.trial030.stdout:Importing pgid 1.0 2026-02-13T20:15:19.060 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:023dd3d2:::existing_12:head# 2026-02-13T20:15:19.060 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:15:19.060 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:04c40a0c:::existing_93:head# 2026-02-13T20:15:19.060 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:15:19.060 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:064ff5fb:::existing_36:head# 2026-02-13T20:15:19.060 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-13T20:15:19.060 INFO:tasks.workunit.client.0.trial030.stdout:write_pg epoch 51 info 1.0( v 29'100 (29'90,29'100] local-lis/les=50/51 n=3 ec=21/21 lis/c=50/50 les/c/f=51/51/0 sis=50) 2026-02-13T20:15:19.060 INFO:tasks.workunit.client.0.trial030.stdout:Import successful 2026-02-13T20:15:19.164 INFO:tasks.workunit.client.0.trial030.stdout:reviving divergent 1 2026-02-13T20:15:19.164 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:805: TEST_divergent_3: echo 'reviving divergent 1' 2026-02-13T20:15:19.164 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:806: TEST_divergent_3: ceph pg dump pgs 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.260209+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.1e 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.260127+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.1d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.257987+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.255282+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.257843+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.9 3 1 1 0 0 1600 0 0 11 89 11 active+recovery_wait+degraded 2026-02-13T20:15:17.258673+0000 29'100 51:141 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.8 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.253603+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.257413+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.6 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.257947+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.5 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.254186+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.259134+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.253996+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.2 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.257339+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.c 3 0 0 0 0 1600 0 0 14 86 14 active+clean 2026-02-13T20:15:17.257377+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.1 4 0 0 0 0 1600 0 0 15 85 15 active+clean 2026-02-13T20:15:17.257661+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.1c 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.260188+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.0 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.253786+0000 29'100 51:143 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.d 3 0 0 0 0 1600 0 0 12 88 12 active+clean 2026-02-13T20:15:17.253840+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.e 3 1 1 0 0 2088 0 0 14 87 14 active+recovering+degraded 2026-02-13T20:15:17.260367+0000 45'101 51:142 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.260156+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.10 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.257486+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.11 3 1 1 0 0 1600 0 0 16 84 16 active+recovery_wait+degraded 2026-02-13T20:15:17.258988+0000 29'100 51:141 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.12 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.260122+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.13 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.258756+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.260191+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.15 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.256811+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.259002+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.258986+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:17.255270+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.19 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.260005+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.1a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:17.259047+0000 29'100 51:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout:1.1b 3 1 1 0 0 1600 0 0 10 90 10 active+recovery_wait+degraded 2026-02-13T20:15:17.258618+0000 29'100 51:141 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:15:19.370 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:15:19.371 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:15:19.371 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:15:19.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:807: TEST_divergent_3: activate_osd td/divergent-priors 1 2026-02-13T20:15:19.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T20:15:19.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T20:15:19.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T20:15:19.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T20:15:19.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-13T20:15:19.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:15:19.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:15:19.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:15:19.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:15:19.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T20:15:19.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T20:15:19.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T20:15:19.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T20:15:19.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:15:19.382 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T20:15:19.382 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:15:19.382 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:15:19.382 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:15:19.382 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:15:19.382 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:15:19.382 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:15:19.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:15:19.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:15:19.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:15:19.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:15:19.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:15:19.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:15:19.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:15:19.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:15:19.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T20:15:19.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T20:15:19.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-13T20:15:19.384 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T20:15:19.384 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-13T20:15:19.384 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:15:19.384 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-13T20:15:19.386 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T20:15:19.386 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T20:15:19.386 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T20:15:19.386 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T20:15:19.407 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:19.401+0000 7f61968efa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:19.408 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:19.405+0000 7f61968efa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:19.409 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:19.405+0000 7f61968efa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:19.606 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-13T20:15:19.607 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:15:19.607 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T20:15:19.607 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:15:19.607 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:15:19.607 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:15:19.607 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:15:19.608 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:15:19.608 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:15:19.608 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:15:19.774 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:19.769+0000 7f61968efa40 -1 Falling back to public interface 2026-02-13T20:15:19.825 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 50 up_thru 50 down_at 31 last_clean_interval [10,29) [v2:127.0.0.1:6818/4101757710,v1:127.0.0.1:6819/4101757710] [v2:127.0.0.1:6820/4101757710,v1:127.0.0.1:6821/4101757710] exists,up 58e5ae01-f34d-4563-8340-e58b1e0c4c9c 2026-02-13T20:15:19.826 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:15:19.826 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:15:19.826 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:15:19.827 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:808: TEST_divergent_3: wait_for_osd up 1 2026-02-13T20:15:19.827 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:15:19.827 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T20:15:19.827 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:15:19.827 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:15:19.827 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:15:19.827 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:15:19.827 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:15:19.828 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:15:19.828 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:15:20.034 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 50 up_thru 50 down_at 31 last_clean_interval [10,29) [v2:127.0.0.1:6818/4101757710,v1:127.0.0.1:6819/4101757710] [v2:127.0.0.1:6820/4101757710,v1:127.0.0.1:6821/4101757710] exists,up 58e5ae01-f34d-4563-8340-e58b1e0c4c9c 2026-02-13T20:15:20.035 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:15:20.035 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:15:20.035 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:15:20.035 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:810: TEST_divergent_3: sleep 20 2026-02-13T20:15:20.547 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:20.541+0000 7f61968efa40 -1 osd.1 52 log_to_monitors true 2026-02-13T20:15:40.037 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: get_asok_path osd.1 2026-02-13T20:15:40.037 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T20:15:40.037 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T20:15:40.037 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:15:40.037 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:15:40.038 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:15:40.038 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.1.asok 2026-02-13T20:15:40.038 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: CEPH_ARGS= 2026-02-13T20:15:40.038 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.1.asok dump_ops_in_flight 2026-02-13T20:15:40.099 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-13T20:15:40.099 INFO:tasks.workunit.client.0.trial030.stdout: "ops": [], 2026-02-13T20:15:40.099 INFO:tasks.workunit.client.0.trial030.stdout: "num_ops": 0 2026-02-13T20:15:40.099 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-13T20:15:40.104 INFO:tasks.workunit.client.0.trial030.stdout:allowing recovery 2026-02-13T20:15:40.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:813: TEST_divergent_3: echo 'allowing recovery' 2026-02-13T20:15:40.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:814: TEST_divergent_3: ceph pg dump pgs 2026-02-13T20:15:40.314 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:15:40.314 INFO:tasks.workunit.client.0.trial030.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:29.982210+0000 29'100 64:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.314 INFO:tasks.workunit.client.0.trial030.stdout:1.1e 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:27.982692+0000 29'100 62:170 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.314 INFO:tasks.workunit.client.0.trial030.stdout:1.1d 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-13T20:15:27.412205+0000 29'100 67:167 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-13T20:15:27.412162+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 periodic scrub scheduled @ 2026-02-15T02:01:39.256695+0000 4 0 2026-02-13T20:15:40.314 INFO:tasks.workunit.client.0.trial030.stdout:1.b 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-13T20:15:34.680275+0000 29'100 64:182 [1,2,0] 1 [1,2,0] 1 29'100 2026-02-13T20:15:34.680221+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 periodic scrub scheduled @ 2026-02-15T00:00:18.302243+0000 3 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:27.981955+0000 29'100 66:181 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.9 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:25.983633+0000 29'100 67:159 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.8 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-13T20:15:28.584571+0000 29'100 64:185 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-13T20:15:28.584529+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 periodic scrub scheduled @ 2026-02-15T05:49:59.528875+0000 3 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:29.982052+0000 29'100 64:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.6 4 0 0 0 0 2112 0 0 17 84 17 active+clean 2026-02-13T20:15:27.982655+0000 52'101 62:163 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.5 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:25.983474+0000 29'100 67:159 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:20.918060+0000 29'100 64:176 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:29.982153+0000 29'100 64:174 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.2 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:27.982659+0000 29'100 66:181 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.c 3 0 0 0 0 1536 0 0 14 86 14 active+clean 2026-02-13T20:15:22.529167+0000 29'100 64:185 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-13T20:15:22.529124+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 periodic scrub scheduled @ 2026-02-15T00:48:49.587735+0000 3 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.1 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:25.983929+0000 29'100 67:159 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.1c 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:20.916923+0000 29'100 64:176 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-13T20:15:29.617126+0000 29'100 64:185 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-13T20:15:29.617087+0000 0'0 2026-02-13T20:13:39.201119+0000 0 1 periodic scrub scheduled @ 2026-02-14T22:43:30.176989+0000 3 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:25.983808+0000 29'100 67:159 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.e 3 0 0 0 0 2088 0 0 17 84 17 active+clean 2026-02-13T20:15:27.982413+0000 45'101 62:171 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:29.981677+0000 29'100 64:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.10 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:20.920954+0000 29'100 64:177 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.11 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-13T20:15:36.294367+0000 29'100 67:167 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-13T20:15:36.294307+0000 0'0 2026-02-13T20:13:39.201119+0000 0 1 periodic scrub scheduled @ 2026-02-14T23:26:24.605219+0000 3 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.12 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-13T20:15:35.424267+0000 29'100 66:189 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-13T20:15:35.424229+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 periodic scrub scheduled @ 2026-02-14T23:40:29.252342+0000 1 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.13 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:29.982671+0000 29'100 64:174 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:20.919942+0000 29'100 64:177 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.15 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:25.983144+0000 29'100 67:159 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:27.982842+0000 29'100 62:170 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:29.982739+0000 29'100 64:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:20.920881+0000 29'100 64:177 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.19 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-13T20:15:33.337062+0000 29'100 67:167 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-13T20:15:33.337002+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 periodic scrub scheduled @ 2026-02-15T06:25:34.386954+0000 2 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.1a 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-13T20:15:34.446636+0000 29'100 66:188 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-13T20:15:34.446578+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 periodic scrub scheduled @ 2026-02-14T23:51:36.572918+0000 4 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:1.1b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:29.982762+0000 29'100 64:175 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:15:40.315 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:15:40.323 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-13T20:15:40.323 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-13T20:15:40.412 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T20:15:40.419 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-13T20:15:40.419 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-13T20:15:40.501 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T20:15:40.508 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-13T20:15:40.508 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-13T20:15:40.582 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T20:15:40.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:821: TEST_divergent_3: echo 'reading divergent objects' 2026-02-13T20:15:40.592 INFO:tasks.workunit.client.0.trial030.stdout:reading divergent objects 2026-02-13T20:15:40.592 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:822: TEST_divergent_3: ceph pg dump pgs 2026-02-13T20:15:40.801 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:15:40.801 INFO:tasks.workunit.client.0.trial030.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:29.982210+0000 29'100 64:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.801 INFO:tasks.workunit.client.0.trial030.stdout:1.1e 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:27.982692+0000 29'100 62:170 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.801 INFO:tasks.workunit.client.0.trial030.stdout:1.1d 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-13T20:15:27.412205+0000 29'100 67:167 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-13T20:15:27.412162+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 periodic scrub scheduled @ 2026-02-15T02:01:39.256695+0000 4 0 2026-02-13T20:15:40.801 INFO:tasks.workunit.client.0.trial030.stdout:1.b 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-13T20:15:34.680275+0000 29'100 64:182 [1,2,0] 1 [1,2,0] 1 29'100 2026-02-13T20:15:34.680221+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 periodic scrub scheduled @ 2026-02-15T00:00:18.302243+0000 3 0 2026-02-13T20:15:40.801 INFO:tasks.workunit.client.0.trial030.stdout:1.a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:27.981955+0000 29'100 66:181 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.802 INFO:tasks.workunit.client.0.trial030.stdout:1.9 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:25.983633+0000 29'100 67:159 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.802 INFO:tasks.workunit.client.0.trial030.stdout:1.8 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-13T20:15:28.584571+0000 29'100 64:185 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-13T20:15:28.584529+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 periodic scrub scheduled @ 2026-02-15T05:49:59.528875+0000 3 0 2026-02-13T20:15:40.802 INFO:tasks.workunit.client.0.trial030.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:29.982052+0000 29'100 64:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.802 INFO:tasks.workunit.client.0.trial030.stdout:1.6 4 0 0 0 0 2112 0 0 17 84 17 active+clean 2026-02-13T20:15:27.982655+0000 52'101 62:163 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.802 INFO:tasks.workunit.client.0.trial030.stdout:1.5 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:25.983474+0000 29'100 67:159 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.802 INFO:tasks.workunit.client.0.trial030.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:20.918060+0000 29'100 64:176 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.802 INFO:tasks.workunit.client.0.trial030.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:29.982153+0000 29'100 64:174 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.802 INFO:tasks.workunit.client.0.trial030.stdout:1.2 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:27.982659+0000 29'100 66:181 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.803 INFO:tasks.workunit.client.0.trial030.stdout:1.c 3 0 0 0 0 1536 0 0 14 86 14 active+clean 2026-02-13T20:15:22.529167+0000 29'100 64:185 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-13T20:15:22.529124+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 periodic scrub scheduled @ 2026-02-15T00:48:49.587735+0000 3 0 2026-02-13T20:15:40.803 INFO:tasks.workunit.client.0.trial030.stdout:1.1 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:25.983929+0000 29'100 67:159 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.803 INFO:tasks.workunit.client.0.trial030.stdout:1.1c 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:20.916923+0000 29'100 64:176 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.803 INFO:tasks.workunit.client.0.trial030.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-13T20:15:29.617126+0000 29'100 64:185 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-13T20:15:29.617087+0000 0'0 2026-02-13T20:13:39.201119+0000 0 1 periodic scrub scheduled @ 2026-02-14T22:43:30.176989+0000 3 0 2026-02-13T20:15:40.803 INFO:tasks.workunit.client.0.trial030.stdout:1.d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:25.983808+0000 29'100 67:159 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.803 INFO:tasks.workunit.client.0.trial030.stdout:1.e 3 0 0 0 0 2088 0 0 17 84 17 active+clean 2026-02-13T20:15:27.982413+0000 45'101 62:171 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.803 INFO:tasks.workunit.client.0.trial030.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:29.981677+0000 29'100 64:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.804 INFO:tasks.workunit.client.0.trial030.stdout:1.10 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:20.920954+0000 29'100 64:177 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.804 INFO:tasks.workunit.client.0.trial030.stdout:1.11 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-13T20:15:36.294367+0000 29'100 67:167 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-13T20:15:36.294307+0000 0'0 2026-02-13T20:13:39.201119+0000 0 1 periodic scrub scheduled @ 2026-02-14T23:26:24.605219+0000 3 0 2026-02-13T20:15:40.804 INFO:tasks.workunit.client.0.trial030.stdout:1.12 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-13T20:15:35.424267+0000 29'100 66:189 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-13T20:15:35.424229+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 periodic scrub scheduled @ 2026-02-14T23:40:29.252342+0000 1 0 2026-02-13T20:15:40.804 INFO:tasks.workunit.client.0.trial030.stdout:1.13 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:29.982671+0000 29'100 64:174 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.804 INFO:tasks.workunit.client.0.trial030.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:20.919942+0000 29'100 64:177 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.804 INFO:tasks.workunit.client.0.trial030.stdout:1.15 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:25.983144+0000 29'100 67:159 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.804 INFO:tasks.workunit.client.0.trial030.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:27.982842+0000 29'100 62:170 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.804 INFO:tasks.workunit.client.0.trial030.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T20:15:29.982739+0000 29'100 64:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.805 INFO:tasks.workunit.client.0.trial030.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:20.920881+0000 29'100 64:177 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.805 INFO:tasks.workunit.client.0.trial030.stdout:1.19 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-13T20:15:33.337062+0000 29'100 67:167 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-13T20:15:33.337002+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 periodic scrub scheduled @ 2026-02-15T06:25:34.386954+0000 2 0 2026-02-13T20:15:40.805 INFO:tasks.workunit.client.0.trial030.stdout:1.1a 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-13T20:15:34.446636+0000 29'100 66:188 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-13T20:15:34.446578+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 periodic scrub scheduled @ 2026-02-14T23:51:36.572918+0000 4 0 2026-02-13T20:15:40.805 INFO:tasks.workunit.client.0.trial030.stdout:1.1b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T20:15:29.982762+0000 29'100 64:175 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T20:13:39.201119+0000 0'0 2026-02-13T20:13:39.201119+0000 0 0 queued for scrub 0 0 2026-02-13T20:15:40.805 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:15:40.805 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:15:40.805 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:15:40.812 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: expr 2 + 2 2026-02-13T20:15:40.813 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: seq 1 4 2026-02-13T20:15:40.814 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T20:15:40.814 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_1 td/divergent-priors/existing 2026-02-13T20:15:40.835 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T20:15:40.835 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_2 td/divergent-priors/existing 2026-02-13T20:15:40.864 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T20:15:40.864 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_3 td/divergent-priors/existing 2026-02-13T20:15:40.890 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T20:15:40.890 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_4 td/divergent-priors/existing 2026-02-13T20:15:40.919 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: seq 1 2 2026-02-13T20:15:40.920 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-13T20:15:40.920 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: rados -p test get newobject_1 td/divergent-priors/existing 2026-02-13T20:15:40.940 INFO:tasks.workunit.client.0.trial030.stderr:error getting test/newobject_1: (2) No such file or directory 2026-02-13T20:15:40.942 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-13T20:15:40.942 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: rados -p test get newobject_2 td/divergent-priors/existing 2026-02-13T20:15:40.967 INFO:tasks.workunit.client.0.trial030.stderr:error getting test/newobject_2: (2) No such file or directory 2026-02-13T20:15:40.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:831: TEST_divergent_3: rm -f td/divergent-priors/existing 2026-02-13T20:15:40.971 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:833: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-13T20:15:40.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:833: TEST_divergent_3: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4b483640 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 29'103 (29'2) modify 1:97db2a0f:::existing_2:head by client.4543.0:1 2026-02-13T20:13:53.803336+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4b483640 20 _merge_object_divergent_entries: keeping 29'103 (29'2) modify 1:97db2a0f:::existing_2:head by client.4543.0:1 2026-02-13T20:13:53.803336+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4b483640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4b483640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 29'2 first_divergent_update: 29'103 last_divergent_update: 29'103 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4b483640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4b483640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4b483640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 29'106 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4b483640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 29'103 (29'2) modify 1:97db2a0f:::existing_2:head by client.4543.0:1 2026-02-13T20:13:53.803336+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4b483640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4b483640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 29'2 <= info.log_tail 29'89 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4cc86640 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 29'106 (29'4) delete 1:70b3bf12:::existing_4:head by client.4549.0:1 2026-02-13T20:13:53.808883+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4cc86640 20 _merge_object_divergent_entries: keeping 29'106 (29'4) delete 1:70b3bf12:::existing_4:head by client.4549.0:1 2026-02-13T20:13:53.808883+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4cc86640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4cc86640 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 29'4 first_divergent_update: 29'106 last_divergent_update: 29'106 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4cc86640 10 _merge_object_divergent_entries: more recent entry found: 45'101 (29'4) modify 1:70b3bf12:::existing_4:head by client.4660.0:1 2026-02-13T20:14:40.800490+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false, already merged 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4cc86640 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 29'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4536.0:1 2026-02-13T20:13:53.800726+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4cc86640 20 _merge_object_divergent_entries: keeping 29'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4536.0:1 2026-02-13T20:13:53.800726+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4cc86640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4cc86640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 29'101 last_divergent_update: 29'101 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4cc86640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4cc86640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4e489640 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 29'104 (29'1) modify 1:d858c035:::existing_1:head by client.4544.0:1 2026-02-13T20:13:53.803599+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4e489640 20 _merge_object_divergent_entries: keeping 29'104 (29'1) modify 1:d858c035:::existing_1:head by client.4544.0:1 2026-02-13T20:13:53.803599+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4e489640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4e489640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 29'1 first_divergent_update: 29'104 last_divergent_update: 29'104 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4e489640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4e489640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4e489640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 29'106 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4e489640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 29'104 (29'1) modify 1:d858c035:::existing_1:head by client.4544.0:1 2026-02-13T20:13:53.803599+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4e489640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4e489640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 29'1 <= info.log_tail 29'90 2026-02-13T20:15:40.977 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4e489640 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 29'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4540.0:1 2026-02-13T20:13:53.802168+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-13T20:15:40.978 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4f48b640 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 29'105 (29'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-13T20:13:53.804615+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-13T20:15:40.985 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4f48b640 20 _merge_object_divergent_entries: keeping 29'105 (29'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-13T20:13:53.804615+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-13T20:15:40.985 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4f48b640 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2026-02-13T20:15:40.985 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4f48b640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 29'3 first_divergent_update: 29'105 last_divergent_update: 29'105 2026-02-13T20:15:40.985 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4f48b640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2026-02-13T20:15:40.985 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4f48b640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2026-02-13T20:15:40.985 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4e489640 20 _merge_object_divergent_entries: keeping 29'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4540.0:1 2026-02-13T20:13:53.802168+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-13T20:15:40.985 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4f48b640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 29'106 2026-02-13T20:15:40.985 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4e489640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T20:15:40.985 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4e489640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 29'102 last_divergent_update: 29'102 2026-02-13T20:15:40.985 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4e489640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2026-02-13T20:15:40.985 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4f48b640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 29'105 (29'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-13T20:13:53.804615+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-13T20:15:40.985 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4e489640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2026-02-13T20:15:40.985 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4f48b640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2026-02-13T20:15:40.985 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:15:17.245+0000 7fdc4f48b640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 29'3 <= info.log_tail 29'84 2026-02-13T20:15:40.985 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:835: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-13T20:15:40.987 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:835: TEST_divergent_3: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-13T20:15:40.990 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:841: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-13T20:15:40.991 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:841: TEST_divergent_3: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-13T20:15:40.994 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:846: TEST_divergent_3: echo success 2026-02-13T20:15:40.994 INFO:tasks.workunit.client.0.trial030.stdout:success 2026-02-13T20:15:40.994 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:848: TEST_divergent_3: rm td/divergent-priors/td/divergent-priors/exp.19555.out 2026-02-13T20:15:40.995 INFO:tasks.workunit.client.0.trial030.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.19555.out': No such file or directory 2026-02-13T20:15:40.995 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:849: TEST_divergent_3: delete_pool test 2026-02-13T20:15:40.995 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-13T20:15:40.995 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-13T20:15:41.250 INFO:tasks.workunit.client.0.trial030.stderr:pool 'test' does not exist 2026-02-13T20:15:41.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:850: TEST_divergent_3: kill_daemons td/divergent-priors 2026-02-13T20:15:41.261 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:15:41.261 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:15:41.261 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:15:41.262 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:15:41.262 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:15:46.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:15:46.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-13T20:15:46.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-13T20:15:46.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T20:15:46.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-13T20:15:46.578 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:15:46.578 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:15:46.578 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:15:46.579 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:15:46.579 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:15:46.585 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:15:46.586 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T20:15:46.587 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T20:15:46.587 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T20:15:46.589 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T20:15:46.589 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T20:15:46.589 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T20:15:46.590 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:15:46.590 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T20:15:46.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T20:15:46.591 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:15:46.592 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:15:46.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T20:15:46.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-13T20:15:46.621 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T20:15:46.621 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:15:46.621 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:15:46.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19555 2026-02-13T20:15:46.623 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T20:15:46.624 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T20:15:46.624 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-13T20:15:46.624 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-13T20:15:46.624 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-13T20:15:46.624 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-13T20:15:46.624 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-13T20:15:46.624 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T20:15:46.624 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-13T20:15:46.624 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:15:46.624 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:15:46.624 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:15:46.625 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:15:46.625 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:15:46.626 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:15:46.626 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T20:15:46.627 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T20:15:46.628 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T20:15:46.629 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T20:15:46.629 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T20:15:46.629 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T20:15:46.630 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:15:46.630 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T20:15:46.631 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T20:15:46.631 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:15:46.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:15:46.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T20:15:46.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-13T20:15:46.635 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T20:15:46.635 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:15:46.635 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:15:46.635 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19555 2026-02-13T20:15:46.636 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T20:15:46.636 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T20:15:46.636 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-13T20:15:46.637 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T20:15:46.637 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:15:46.637 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:15:46.638 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.19555 2026-02-13T20:15:46.639 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T20:15:46.640 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T20:15:46.640 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T20:15:46.640 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-13T20:15:46.640 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_ec td/divergent-priors 2026-02-13T20:15:46.640 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:227: TEST_divergent_ec: local dir=td/divergent-priors 2026-02-13T20:15:46.640 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:229: TEST_divergent_ec: file_with_random_data 2026-02-13T20:15:46.640 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-13T20:15:46.641 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-13T20:15:46.642 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.0WF00CV70Z 2026-02-13T20:15:46.642 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.0WF00CV70Z bs=512 count=1 2026-02-13T20:15:46.643 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records in 2026-02-13T20:15:46.643 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records out 2026-02-13T20:15:46.644 INFO:tasks.workunit.client.0.trial030.stderr:512 bytes copied, 8.141e-05 s, 6.3 MB/s 2026-02-13T20:15:46.644 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.0WF00CV70Z 2026-02-13T20:15:46.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:229: TEST_divergent_ec: local dummyfile=/tmp/tmp.0WF00CV70Z 2026-02-13T20:15:46.644 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:231: TEST_divergent_ec: file_with_random_data 1000 2026-02-13T20:15:46.645 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=1000 2026-02-13T20:15:46.645 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-13T20:15:46.646 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.eC5mlpjQbo 2026-02-13T20:15:46.646 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.eC5mlpjQbo bs=1000 count=1 2026-02-13T20:15:46.647 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records in 2026-02-13T20:15:46.647 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records out 2026-02-13T20:15:46.647 INFO:tasks.workunit.client.0.trial030.stderr:1000 bytes (1.0 kB) copied, 8.0529e-05 s, 12.4 MB/s 2026-02-13T20:15:46.647 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.eC5mlpjQbo 2026-02-13T20:15:46.648 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:231: TEST_divergent_ec: local dummyfile2=/tmp/tmp.eC5mlpjQbo 2026-02-13T20:15:46.648 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:233: TEST_divergent_ec: local num_osds=3 2026-02-13T20:15:46.648 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: expr 3 - 1 2026-02-13T20:15:46.649 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: seq 0 2 2026-02-13T20:15:46.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: local 'osds=0 2026-02-13T20:15:46.651 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:15:46.651 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:15:46.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:235: TEST_divergent_ec: run_mon td/divergent-priors a 2026-02-13T20:15:46.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-13T20:15:46.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T20:15:46.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T20:15:46.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T20:15:46.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-13T20:15:46.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-13T20:15:46.678 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T20:15:46.678 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:15:46.678 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:15:46.679 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:15:46.679 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:15:46.680 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:15:46.680 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:15:46.680 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T20:15:46.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T20:15:46.710 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T20:15:46.710 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T20:15:46.710 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T20:15:46.710 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T20:15:46.712 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T20:15:46.712 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T20:15:46.712 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T20:15:46.712 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T20:15:46.712 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:15:46.712 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:15:46.712 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:15:46.712 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-mon.a.asok 2026-02-13T20:15:46.713 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T20:15:46.713 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19555/ceph-mon.a.asok config get fsid 2026-02-13T20:15:46.770 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T20:15:46.770 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T20:15:46.770 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T20:15:46.770 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T20:15:46.770 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T20:15:46.771 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T20:15:46.771 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T20:15:46.772 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T20:15:46.772 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:15:46.772 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:15:46.772 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:15:46.772 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-mon.a.asok 2026-02-13T20:15:46.772 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T20:15:46.772 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19555/ceph-mon.a.asok config get mon_host 2026-02-13T20:15:46.827 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:236: TEST_divergent_ec: run_mgr td/divergent-priors x 2026-02-13T20:15:46.828 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-13T20:15:46.828 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T20:15:46.828 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T20:15:46.828 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T20:15:46.828 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-13T20:15:46.828 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T20:15:46.944 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T20:15:46.944 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:15:46.944 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:15:46.944 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:15:46.944 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:15:46.945 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:15:46.945 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:15:46.945 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T20:15:46.946 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T20:15:46.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-13T20:15:46.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 0 2026-02-13T20:15:46.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T20:15:46.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:15:46.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T20:15:46.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:15:46.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-13T20:15:46.971 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:15:46.971 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:15:46.971 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:15:46.971 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:15:46.971 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-13T20:15:46.971 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-13T20:15:46.971 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:15:46.971 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:15:46.971 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:15:46.972 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:15:46.972 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:15:46.972 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:15:46.972 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:15:46.972 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:15:46.972 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:15:46.972 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:15:46.972 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:15:46.972 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:15:46.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:15:46.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:15:46.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:15:46.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:15:46.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:15:46.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:15:46.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:15:46.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:15:46.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:15:46.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:15:46.976 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-13T20:15:46.976 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:15:46.976 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f07a9a5d-5587-496d-ae5a-150352e2c1fc 2026-02-13T20:15:46.976 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 f07a9a5d-5587-496d-ae5a-150352e2c1fc' 2026-02-13T20:15:46.976 INFO:tasks.workunit.client.0.trial030.stdout:add osd0 f07a9a5d-5587-496d-ae5a-150352e2c1fc 2026-02-13T20:15:46.977 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:15:46.985 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQByho9pXGC0OhAA0tXEPJ844DA29KF9rixJBA== 2026-02-13T20:15:46.985 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQByho9pXGC0OhAA0tXEPJ844DA29KF9rixJBA=="}' 2026-02-13T20:15:46.985 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f07a9a5d-5587-496d-ae5a-150352e2c1fc -i td/divergent-priors/0/new.json 2026-02-13T20:15:47.098 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:15:47.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-13T20:15:47.107 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQByho9pXGC0OhAA0tXEPJ844DA29KF9rixJBA== --osd-uuid f07a9a5d-5587-496d-ae5a-150352e2c1fc 2026-02-13T20:15:47.125 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:47.124+0000 7fd51e3c1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:47.127 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:47.124+0000 7fd51e3c1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:47.128 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:47.124+0000 7fd51e3c1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:47.129 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:47.128+0000 7fd51e3c1a40 -1 bdev(0x556ab31a6400 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-13T20:15:47.129 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:47.128+0000 7fd51e3c1a40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-13T20:15:47.863 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-13T20:15:47.864 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:15:47.865 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T20:15:47.865 INFO:tasks.workunit.client.0.trial030.stdout:adding osd0 key to auth repository 2026-02-13T20:15:47.865 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:15:47.990 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-13T20:15:47.991 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T20:15:47.991 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:15:47.991 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:15:47.991 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:15:47.991 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:15:48.023 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:48.020+0000 7f69697e5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:48.025 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:48.024+0000 7f69697e5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:48.026 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:48.024+0000 7f69697e5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:48.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T20:15:48.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:15:48.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T20:15:48.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:15:48.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:15:48.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:15:48.106 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:15:48.106 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:15:48.106 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:15:48.106 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:15:48.220 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:15:48.522 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:48.520+0000 7f69697e5a40 -1 Falling back to public interface 2026-02-13T20:15:49.222 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:15:49.222 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:15:49.222 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:15:49.223 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:15:49.223 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:15:49.223 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:15:49.442 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:15:49.490 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:49.488+0000 7f69697e5a40 -1 osd.0 0 log_to_monitors true 2026-02-13T20:15:50.443 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:15:50.444 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:15:50.444 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:15:50.445 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T20:15:50.445 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:15:50.445 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:15:50.658 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2459707814,v1:127.0.0.1:6801/2459707814] [v2:127.0.0.1:6802/2459707814,v1:127.0.0.1:6803/2459707814] exists,up f07a9a5d-5587-496d-ae5a-150352e2c1fc 2026-02-13T20:15:50.662 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:15:50.662 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:15:50.662 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:15:50.662 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-13T20:15:50.662 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 1 2026-02-13T20:15:50.662 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T20:15:50.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:15:50.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T20:15:50.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:15:50.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-13T20:15:50.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:15:50.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:15:50.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:15:50.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:15:50.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T20:15:50.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T20:15:50.664 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:15:50.664 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:15:50.664 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:15:50.664 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:15:50.664 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:15:50.664 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:15:50.664 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:15:50.664 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:15:50.664 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:15:50.664 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:15:50.664 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:15:50.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:15:50.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:15:50.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:15:50.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:15:50.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:15:50.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:15:50.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:15:50.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:15:50.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:15:50.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:15:50.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:15:50.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-13T20:15:50.666 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:15:50.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c7c6b311-7783-4c87-a03d-8e96a204ca78 2026-02-13T20:15:50.667 INFO:tasks.workunit.client.0.trial030.stdout:add osd1 c7c6b311-7783-4c87-a03d-8e96a204ca78 2026-02-13T20:15:50.667 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 c7c6b311-7783-4c87-a03d-8e96a204ca78' 2026-02-13T20:15:50.667 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:15:50.676 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB2ho9p9u1PKBAA5rmJ7xoryZG36RFWQbj4UA== 2026-02-13T20:15:50.677 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB2ho9p9u1PKBAA5rmJ7xoryZG36RFWQbj4UA=="}' 2026-02-13T20:15:50.677 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c7c6b311-7783-4c87-a03d-8e96a204ca78 -i td/divergent-priors/1/new.json 2026-02-13T20:15:50.896 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:15:50.905 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-13T20:15:50.906 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB2ho9p9u1PKBAA5rmJ7xoryZG36RFWQbj4UA== --osd-uuid c7c6b311-7783-4c87-a03d-8e96a204ca78 2026-02-13T20:15:50.926 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:50.924+0000 7f66895faa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:50.927 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:50.924+0000 7f66895faa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:50.928 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:50.928+0000 7f66895faa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:50.929 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:50.928+0000 7f66895faa40 -1 bdev(0x556bdeee2400 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-13T20:15:50.929 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:50.928+0000 7f66895faa40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-13T20:15:51.546 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-13T20:15:51.547 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:15:51.548 INFO:tasks.workunit.client.0.trial030.stdout:adding osd1 key to auth repository 2026-02-13T20:15:51.548 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T20:15:51.548 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:15:51.840 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-13T20:15:51.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T20:15:51.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:15:51.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:15:51.842 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:15:51.842 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:15:51.860 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:51.860+0000 7f88e464ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:51.862 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:51.860+0000 7f88e464ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:51.863 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:51.860+0000 7f88e464ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:52.052 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T20:15:52.052 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:15:52.052 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T20:15:52.052 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:15:52.052 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:15:52.052 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:15:52.053 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:15:52.053 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:15:52.053 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:15:52.054 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:15:52.270 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:15:52.281 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:52.280+0000 7f88e464ca40 -1 Falling back to public interface 2026-02-13T20:15:52.914 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:52.912+0000 7f88e464ca40 -1 osd.1 0 log_to_monitors true 2026-02-13T20:15:53.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:15:53.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:15:53.271 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:15:53.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:15:53.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:15:53.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:15:53.484 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:15:54.487 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:15:54.487 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:15:54.488 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:15:54.489 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T20:15:54.489 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:15:54.489 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:15:54.704 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1652690354,v1:127.0.0.1:6811/1652690354] [v2:127.0.0.1:6812/1652690354,v1:127.0.0.1:6813/1652690354] exists,up c7c6b311-7783-4c87-a03d-8e96a204ca78 2026-02-13T20:15:54.707 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:15:54.708 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:15:54.708 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:15:54.708 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-13T20:15:54.708 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 2 2026-02-13T20:15:54.708 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T20:15:54.708 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:15:54.708 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T20:15:54.708 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:15:54.708 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-13T20:15:54.708 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:15:54.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:15:54.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:15:54.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:15:54.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-13T20:15:54.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-13T20:15:54.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:15:54.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:15:54.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:15:54.709 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:15:54.709 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:15:54.709 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:15:54.709 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:15:54.710 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:15:54.710 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:15:54.710 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:15:54.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:15:54.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:15:54.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:15:54.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:15:54.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:15:54.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:15:54.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:15:54.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:15:54.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:15:54.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:15:54.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:15:54.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:15:54.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-13T20:15:54.711 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:15:54.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3a006542-89c5-41a2-bd52-742aba707d2e 2026-02-13T20:15:54.712 INFO:tasks.workunit.client.0.trial030.stdout:add osd2 3a006542-89c5-41a2-bd52-742aba707d2e 2026-02-13T20:15:54.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 3a006542-89c5-41a2-bd52-742aba707d2e' 2026-02-13T20:15:54.712 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:15:54.724 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB6ho9pqYciKxAAy86SnWRaBxC6xFkhnZLPvA== 2026-02-13T20:15:54.724 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB6ho9pqYciKxAAy86SnWRaBxC6xFkhnZLPvA=="}' 2026-02-13T20:15:54.724 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3a006542-89c5-41a2-bd52-742aba707d2e -i td/divergent-priors/2/new.json 2026-02-13T20:15:54.950 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:15:54.959 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-13T20:15:54.960 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB6ho9pqYciKxAAy86SnWRaBxC6xFkhnZLPvA== --osd-uuid 3a006542-89c5-41a2-bd52-742aba707d2e 2026-02-13T20:15:54.980 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:54.980+0000 7f4cd8937a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:54.981 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:54.980+0000 7f4cd8937a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:54.982 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:54.980+0000 7f4cd8937a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:54.983 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:54.980+0000 7f4cd8937a40 -1 bdev(0x5633d3586400 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-13T20:15:54.983 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:54.980+0000 7f4cd8937a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-13T20:15:55.647 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-13T20:15:55.647 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:15:55.648 INFO:tasks.workunit.client.0.trial030.stdout:adding osd2 key to auth repository 2026-02-13T20:15:55.648 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T20:15:55.649 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:15:55.946 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-13T20:15:55.947 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T20:15:55.947 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:15:55.947 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:15:55.947 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:15:55.947 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:15:55.976 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:55.972+0000 7f8b94d31a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:55.977 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:55.976+0000 7f8b94d31a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:55.978 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:55.976+0000 7f8b94d31a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:15:56.157 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T20:15:56.158 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:15:56.158 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T20:15:56.158 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:15:56.158 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:15:56.158 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:15:56.159 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:15:56.159 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:15:56.160 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:15:56.160 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:15:56.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:15:56.381 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:56.380+0000 7f8b94d31a40 -1 Falling back to public interface 2026-02-13T20:15:56.981 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:15:56.980+0000 7f8b94d31a40 -1 osd.2 0 log_to_monitors true 2026-02-13T20:15:57.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:15:57.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:15:57.381 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:15:57.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:15:57.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:15:57.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:15:57.614 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/527809237,v1:127.0.0.1:6819/527809237] [v2:127.0.0.1:6820/527809237,v1:127.0.0.1:6821/527809237] exists,up 3a006542-89c5-41a2-bd52-742aba707d2e 2026-02-13T20:15:57.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:15:57.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:15:57.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:15:57.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:242: TEST_divergent_ec: ceph osd set noout 2026-02-13T20:15:57.904 INFO:tasks.workunit.client.0.trial030.stderr:noout is set 2026-02-13T20:15:57.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:243: TEST_divergent_ec: ceph osd set noin 2026-02-13T20:15:58.209 INFO:tasks.workunit.client.0.trial030.stderr:noin is set 2026-02-13T20:15:58.219 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:244: TEST_divergent_ec: ceph osd set nodown 2026-02-13T20:15:58.514 INFO:tasks.workunit.client.0.trial030.stderr:nodown is set 2026-02-13T20:15:58.524 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:245: TEST_divergent_ec: create_ec_pool test true k=2 m=1 2026-02-13T20:15:58.524 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=test 2026-02-13T20:15:58.524 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-13T20:15:58.524 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=true 2026-02-13T20:15:58.524 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-13T20:15:58.524 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 2026-02-13T20:15:58.782 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool test 1 1 erasure myprofile 2026-02-13T20:15:58.782 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 erasure myprofile 2026-02-13T20:15:59.140 INFO:tasks.workunit.client.0.trial030.stderr:pool 'test' already exists 2026-02-13T20:15:59.150 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T20:16:00.152 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' true = true ']' 2026-02-13T20:16:00.152 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2531: create_ec_pool: ceph osd pool set test allow_ec_overwrites true 2026-02-13T20:16:00.463 INFO:tasks.workunit.client.0.trial030.stderr:set pool 1 allow_ec_overwrites to true 2026-02-13T20:16:00.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-13T20:16:00.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T20:16:00.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T20:16:00.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T20:16:00.475 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T20:16:00.476 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T20:16:00.476 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T20:16:00.477 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T20:16:00.477 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T20:16:00.477 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T20:16:00.581 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T20:16:00.581 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T20:16:00.582 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T20:16:00.582 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T20:16:00.582 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T20:16:00.582 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T20:16:00.790 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T20:16:00.791 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:16:00.791 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:16:00.791 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T20:16:00.791 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:16:00.791 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-13T20:16:00.872 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-13T20:16:00.872 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-13T20:16:00.872 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-13T20:16:00.872 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:16:00.872 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-13T20:16:00.956 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-13T20:16:00.956 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-13T20:16:00.956 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668' 2026-02-13T20:16:00.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:16:00.957 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-13T20:16:01.038 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-13T20:16:01.038 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-13T20:16:01.038 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668 2-60129542147' 2026-02-13T20:16:01.038 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:16:01.039 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-13T20:16:01.039 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:16:01.039 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-13T20:16:01.040 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-13T20:16:01.040 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:16:01.041 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-13T20:16:01.042 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836485 2026-02-13T20:16:01.042 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-13T20:16:01.042 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:16:01.262 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-13T20:16:01.263 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:16:01.263 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-13T20:16:01.264 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:16:01.264 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-13T20:16:01.265 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-13T20:16:01.265 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:16:01.267 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-13T20:16:01.267 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 38654705668 2026-02-13T20:16:01.267 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-13T20:16:01.268 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T20:16:01.495 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-13T20:16:01.496 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:16:01.496 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-13T20:16:01.496 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:16:01.497 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-13T20:16:01.498 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-13T20:16:01.498 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:16:01.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-13T20:16:01.500 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 60129542147 2026-02-13T20:16:01.500 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-13T20:16:01.500 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:16:01.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-13T20:16:01.728 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T20:16:01.728 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:16:01.728 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:16:02.021 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T20:16:02.021 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:16:02.021 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:16:02.021 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:16:02.021 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:16:02.022 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:16:02.022 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:16:02.022 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:16:02.234 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-13T20:16:02.235 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:16:02.235 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:16:02.236 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:16:02.534 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-13T20:16:02.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T20:16:02.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T20:16:02.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-13T20:16:02.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:247: TEST_divergent_ec: flush_pg_stats 2026-02-13T20:16:02.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T20:16:02.535 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T20:16:02.743 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T20:16:02.744 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:16:02.744 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:16:02.744 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T20:16:02.744 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:16:02.744 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-13T20:16:02.829 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-13T20:16:02.829 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-13T20:16:02.829 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-13T20:16:02.829 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:16:02.829 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-13T20:16:02.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-13T20:16:02.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-13T20:16:02.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705670' 2026-02-13T20:16:02.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:16:02.913 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-13T20:16:02.993 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542149 2026-02-13T20:16:02.993 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542149 2026-02-13T20:16:02.993 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705670 2-60129542149' 2026-02-13T20:16:02.994 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:16:02.994 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-13T20:16:02.994 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:16:02.995 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-13T20:16:02.996 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-13T20:16:02.996 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:16:02.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-13T20:16:02.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-13T20:16:02.998 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836487 2026-02-13T20:16:02.998 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:16:03.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-13T20:16:03.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:16:04.216 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T20:16:04.216 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:16:04.436 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-13T20:16:04.436 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:16:04.436 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705670 2026-02-13T20:16:04.437 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:16:04.438 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-13T20:16:04.438 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-13T20:16:04.439 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:16:04.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705670 2026-02-13T20:16:04.440 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 38654705670 2026-02-13T20:16:04.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-13T20:16:04.440 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T20:16:04.671 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705670 -lt 38654705670 2026-02-13T20:16:04.671 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:16:04.672 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542149 2026-02-13T20:16:04.672 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:16:04.673 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-13T20:16:04.674 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542149 2026-02-13T20:16:04.674 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:16:04.675 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542149 2026-02-13T20:16:04.675 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 60129542149 2026-02-13T20:16:04.676 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542149' 2026-02-13T20:16:04.676 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:16:04.891 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542150 -lt 60129542149 2026-02-13T20:16:04.891 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:248: TEST_divergent_ec: wait_for_clean 2026-02-13T20:16:04.891 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T20:16:04.891 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T20:16:04.891 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T20:16:04.891 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T20:16:04.892 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T20:16:04.892 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T20:16:04.892 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T20:16:04.893 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T20:16:04.893 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T20:16:04.991 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T20:16:04.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T20:16:04.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T20:16:04.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T20:16:04.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T20:16:04.992 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T20:16:05.200 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T20:16:05.201 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:16:05.201 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:16:05.201 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T20:16:05.201 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:16:05.201 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-13T20:16:05.281 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836489 2026-02-13T20:16:05.281 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836489 2026-02-13T20:16:05.281 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836489' 2026-02-13T20:16:05.281 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:16:05.281 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-13T20:16:05.366 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705673 2026-02-13T20:16:05.367 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705673 2026-02-13T20:16:05.367 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836489 1-38654705673' 2026-02-13T20:16:05.367 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:16:05.367 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-13T20:16:05.448 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542152 2026-02-13T20:16:05.448 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542152 2026-02-13T20:16:05.448 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836489 1-38654705673 2-60129542152' 2026-02-13T20:16:05.448 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:16:05.449 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836489 2026-02-13T20:16:05.449 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:16:05.450 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-13T20:16:05.450 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836489 2026-02-13T20:16:05.450 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:16:05.452 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836489 2026-02-13T20:16:05.452 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836489 2026-02-13T20:16:05.452 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836489' 2026-02-13T20:16:05.453 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:16:05.681 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836489 2026-02-13T20:16:05.682 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:16:06.683 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T20:16:06.683 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:16:06.897 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836489 2026-02-13T20:16:06.897 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:16:07.899 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-13T20:16:07.900 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:16:08.122 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836489 2026-02-13T20:16:08.123 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:16:08.123 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705673 2026-02-13T20:16:08.123 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:16:08.124 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-13T20:16:08.125 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705673 2026-02-13T20:16:08.126 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:16:08.126 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705673 2026-02-13T20:16:08.127 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 38654705673 2026-02-13T20:16:08.127 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705673' 2026-02-13T20:16:08.127 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T20:16:08.352 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705673 -lt 38654705673 2026-02-13T20:16:08.352 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:16:08.353 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542152 2026-02-13T20:16:08.353 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:16:08.354 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-13T20:16:08.355 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542152 2026-02-13T20:16:08.355 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:16:08.356 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542152 2026-02-13T20:16:08.357 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 60129542152 2026-02-13T20:16:08.357 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542152' 2026-02-13T20:16:08.357 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:16:08.574 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542152 -lt 60129542152 2026-02-13T20:16:08.574 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T20:16:08.575 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:16:08.575 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:16:08.866 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T20:16:08.866 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:16:08.866 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:16:08.866 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:16:08.866 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:16:08.866 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:16:08.867 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:16:08.867 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:16:09.083 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-13T20:16:09.083 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:16:09.084 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:16:09.084 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:16:09.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-13T20:16:09.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T20:16:09.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T20:16:09.373 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: ceph pg dump pgs --format=json 2026-02-13T20:16:09.373 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: jq '.pg_stats[0].up_primary' 2026-02-13T20:16:09.581 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:16:09.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: local divergent=1 2026-02-13T20:16:09.591 INFO:tasks.workunit.client.0.trial030.stdout:primary and soon to be divergent is 1 2026-02-13T20:16:09.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:252: TEST_divergent_ec: echo 'primary and soon to be divergent is 1' 2026-02-13T20:16:09.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:253: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T20:16:09.791 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:16:09.792 INFO:tasks.workunit.client.0.trial030.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T20:15:59.795619+0000 0'0 27:18 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:15:59.088125+0000 0'0 2026-02-13T20:15:59.088125+0000 0 0 periodic scrub scheduled @ 2026-02-14T23:26:38.123187+0000 0 0 2026-02-13T20:16:09.792 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:16:09.792 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:16:09.792 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:16:09.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:254: TEST_divergent_ec: local non_divergent= 2026-02-13T20:16:09.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-13T20:16:09.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 0 = 1 ']' 2026-02-13T20:16:09.802 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:260: TEST_divergent_ec: non_divergent=' 0' 2026-02-13T20:16:09.802 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-13T20:16:09.802 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 1 = 1 ']' 2026-02-13T20:16:09.802 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:258: TEST_divergent_ec: continue 2026-02-13T20:16:09.802 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-13T20:16:09.802 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 2 = 1 ']' 2026-02-13T20:16:09.802 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:260: TEST_divergent_ec: non_divergent=' 0 2' 2026-02-13T20:16:09.802 INFO:tasks.workunit.client.0.trial030.stdout:writing initial objects 2026-02-13T20:16:09.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:263: TEST_divergent_ec: echo 'writing initial objects' 2026-02-13T20:16:09.803 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: seq 1 100 2026-02-13T20:16:09.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:09.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_1 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:09.825 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:09.825 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_2 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:09.853 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:09.853 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_3 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:09.880 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:09.880 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_4 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:09.903 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:09.903 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_5 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:09.930 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:09.930 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_6 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:09.958 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:09.958 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_7 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:09.986 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:09.986 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_8 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.014 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.014 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_9 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.042 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.042 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_10 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.071 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.071 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_11 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.099 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.099 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_12 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.128 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.128 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_13 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.157 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.157 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_14 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.186 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.186 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_15 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.214 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_16 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.236 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.236 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_17 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_18 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.284 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.284 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_19 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.311 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.311 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_20 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.339 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.339 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_21 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.359 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.359 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_22 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.389 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.389 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_23 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.416 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.416 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_24 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.445 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.445 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_25 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_26 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.502 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.503 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_27 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.531 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.531 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_28 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.560 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.560 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_29 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.589 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.589 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_30 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.618 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.618 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_31 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.646 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.647 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_32 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.675 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_33 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.703 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.703 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_34 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.731 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.732 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_35 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.759 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.760 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_36 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.789 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.789 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_37 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_38 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.846 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.847 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_39 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.875 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.875 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_40 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.895 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.895 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_41 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_42 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.952 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.952 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_43 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:10.981 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:10.981 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_44 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_45 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.038 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.038 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_46 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.066 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.066 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_47 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.088 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.088 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_48 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.110 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_49 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.135 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.135 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_50 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.159 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.159 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_51 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.178 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.179 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_52 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.210 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.210 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_53 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.231 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.231 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_54 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.250 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.250 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_55 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.279 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.279 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_56 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.299 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.300 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_57 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.329 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.329 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_58 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.356 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.356 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_59 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.385 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.385 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_60 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.414 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.414 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_61 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.442 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.442 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_62 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_63 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_64 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.518 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.518 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_65 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.538 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.538 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_66 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.558 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.558 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_67 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.585 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.585 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_68 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_69 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_70 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_71 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.690 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.690 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_72 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.719 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.719 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_73 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.747 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.747 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_74 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_75 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.806 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.806 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_76 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.835 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.835 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_77 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.865 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.865 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_78 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.893 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.893 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_79 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_80 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.935 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.935 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_81 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.964 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.964 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_82 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:11.991 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:11.991 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_83 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:12.019 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:12.019 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_84 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:12.049 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:12.049 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_85 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:12.078 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:12.078 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_86 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:12.106 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:12.106 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_87 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:12.125 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:12.126 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_88 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:12.153 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:12.153 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_89 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:12.175 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:12.175 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_90 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:12.204 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:12.204 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_91 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:12.232 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:12.232 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_92 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:12.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:12.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_93 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:12.278 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:12.278 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_94 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:12.306 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:12.306 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_95 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:12.332 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:12.332 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_96 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:12.354 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:12.354 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_97 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:12.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:12.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_98 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:12.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:12.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_99 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:12.438 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T20:16:12.439 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:12.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:270: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-13T20:16:12.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:270: TEST_divergent_ec: wait_for_clean 2026-02-13T20:16:12.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T20:16:12.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T20:16:12.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T20:16:12.470 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-13T20:16:12.470 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T20:16:12.470 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T20:16:12.470 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T20:16:12.470 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T20:16:12.470 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T20:16:12.539 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-13T20:16:12.539 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T20:16:12.540 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T20:16:12.540 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T20:16:12.540 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T20:16:12.540 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T20:16:12.746 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T20:16:12.746 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:16:12.746 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:16:12.746 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T20:16:12.746 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:16:12.746 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-13T20:16:12.831 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836493 2026-02-13T20:16:12.831 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836493 2026-02-13T20:16:12.831 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493' 2026-02-13T20:16:12.831 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:16:12.831 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-13T20:16:12.916 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705676 2026-02-13T20:16:12.916 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705676 2026-02-13T20:16:12.916 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493 1-38654705676' 2026-02-13T20:16:12.917 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:16:12.917 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-13T20:16:12.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542155 2026-02-13T20:16:12.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542155 2026-02-13T20:16:12.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493 1-38654705676 2-60129542155' 2026-02-13T20:16:12.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:16:12.997 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836493 2026-02-13T20:16:12.998 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:16:12.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-13T20:16:12.999 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836493 2026-02-13T20:16:12.999 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:16:13.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836493 2026-02-13T20:16:13.001 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836493 2026-02-13T20:16:13.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836493' 2026-02-13T20:16:13.001 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:16:13.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836493 2026-02-13T20:16:13.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:16:14.216 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T20:16:14.216 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:16:14.434 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836493 2026-02-13T20:16:14.434 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:16:14.435 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705676 2026-02-13T20:16:14.435 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:16:14.436 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-13T20:16:14.437 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705676 2026-02-13T20:16:14.437 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:16:14.439 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705676 2026-02-13T20:16:14.439 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 38654705676 2026-02-13T20:16:14.439 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705676' 2026-02-13T20:16:14.439 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T20:16:14.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705676 -lt 38654705676 2026-02-13T20:16:14.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:16:14.664 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542155 2026-02-13T20:16:14.664 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:16:14.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-13T20:16:14.666 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542155 2026-02-13T20:16:14.666 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:16:14.667 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542155 2026-02-13T20:16:14.668 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 60129542155 2026-02-13T20:16:14.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542155' 2026-02-13T20:16:14.668 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:16:14.901 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542156 -lt 60129542155 2026-02-13T20:16:14.902 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T20:16:14.903 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:16:14.903 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:16:15.190 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T20:16:15.191 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:16:15.191 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:16:15.191 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:16:15.191 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:16:15.191 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:16:15.191 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:16:15.191 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:16:15.398 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-13T20:16:15.399 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:16:15.399 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:16:15.400 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:16:15.677 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-13T20:16:15.677 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T20:16:15.677 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T20:16:15.678 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:272: TEST_divergent_ec: get_pg test existing_1 2026-02-13T20:16:15.678 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-13T20:16:15.678 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-13T20:16:15.678 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-13T20:16:15.678 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-13T20:16:15.892 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:272: TEST_divergent_ec: local pgid=1.0 2026-02-13T20:16:15.892 INFO:tasks.workunit.client.0.trial030.stdout:blackholing osds 0 2 2026-02-13T20:16:15.893 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:275: TEST_divergent_ec: echo 'blackholing osds 0 2' 2026-02-13T20:16:15.893 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:276: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T20:16:16.095 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:16:16.096 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-13T20:15:59.795619+0000 27'100 27:118 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:15:59.088125+0000 0'0 2026-02-13T20:15:59.088125+0000 0 0 periodic scrub scheduled @ 2026-02-14T23:26:38.123187+0000 0 0 2026-02-13T20:16:16.096 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:16:16.096 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:16:16.096 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:16:16.106 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:277: TEST_divergent_ec: for i in $non_divergent 2026-02-13T20:16:16.107 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: get_asok_path osd.0 2026-02-13T20:16:16.107 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T20:16:16.107 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T20:16:16.108 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:16:16.108 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:16:16.108 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:16:16.108 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.0.asok 2026-02-13T20:16:16.109 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: CEPH_ARGS= 2026-02-13T20:16:16.109 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-13T20:16:16.163 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-13T20:16:16.163 INFO:tasks.workunit.client.0.trial030.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-13T20:16:16.163 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-13T20:16:16.169 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:277: TEST_divergent_ec: for i in $non_divergent 2026-02-13T20:16:16.170 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: get_asok_path osd.2 2026-02-13T20:16:16.170 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-13T20:16:16.170 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-13T20:16:16.171 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:16:16.171 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:16:16.171 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:16:16.171 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.2.asok 2026-02-13T20:16:16.171 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: CEPH_ARGS= 2026-02-13T20:16:16.171 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-13T20:16:16.223 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-13T20:16:16.223 INFO:tasks.workunit.client.0.trial030.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-13T20:16:16.223 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-13T20:16:16.229 INFO:tasks.workunit.client.0.trial030.stdout:writing divergent object 2026-02-13T20:16:16.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:283: TEST_divergent_ec: echo 'writing divergent object' 2026-02-13T20:16:16.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:285: TEST_divergent_ec: sleep 1 2026-02-13T20:16:16.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:284: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.eC5mlpjQbo 2026-02-13T20:16:17.231 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:287: TEST_divergent_ec: rados -p test mksnap snap1 2026-02-13T20:16:17.231 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:286: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:17.332 INFO:tasks.workunit.client.0.trial030.stdout:created pool test snap snap1 2026-02-13T20:16:17.334 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:289: TEST_divergent_ec: sleep 10 2026-02-13T20:16:17.335 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:288: TEST_divergent_ec: expr 100 - 1 2026-02-13T20:16:17.336 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:288: TEST_divergent_ec: rados -p test put existing_99 /tmp/tmp.0WF00CV70Z 2026-02-13T20:16:27.336 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:290: TEST_divergent_ec: killall -9 rados 2026-02-13T20:16:27.380 INFO:tasks.workunit.client.0.trial030.stderr:rados: no process found 2026-02-13T20:16:27.380 INFO:tasks.workunit.client.0.trial030.stdout:killing all the osds 2026-02-13T20:16:27.380 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:293: TEST_divergent_ec: echo 'killing all the osds' 2026-02-13T20:16:27.380 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:294: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T20:16:27.598 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:16:27.598 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 active+clean 2026-02-13T20:15:59.795619+0000 28'104 28:124 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:15:59.088125+0000 0'0 2026-02-13T20:15:59.088125+0000 0 0 periodic scrub scheduled @ 2026-02-14T23:42:42.184504+0000 0 0 2026-02-13T20:16:27.598 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:16:27.599 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:16:27.599 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:16:27.607 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:295: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd 2026-02-13T20:16:27.609 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:16:27.609 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:16:27.609 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:16:27.609 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:16:27.609 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:16:27.716 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:16:27.716 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-13T20:16:27.716 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.0 2026-02-13T20:16:27.983 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already down. 2026-02-13T20:16:27.993 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-13T20:16:27.993 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.1 2026-02-13T20:16:28.265 INFO:tasks.workunit.client.0.trial030.stderr:osd.1 is already down. 2026-02-13T20:16:28.276 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-13T20:16:28.276 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.2 2026-02-13T20:16:28.541 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already down. 2026-02-13T20:16:28.552 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:300: TEST_divergent_ec: for i in $non_divergent 2026-02-13T20:16:28.552 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:302: TEST_divergent_ec: ceph osd out osd.0 2026-02-13T20:16:28.820 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already out. 2026-02-13T20:16:28.829 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:300: TEST_divergent_ec: for i in $non_divergent 2026-02-13T20:16:28.829 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:302: TEST_divergent_ec: ceph osd out osd.2 2026-02-13T20:16:29.107 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already out. 2026-02-13T20:16:29.116 INFO:tasks.workunit.client.0.trial030.stdout:bringing up non_divergent 0 2 2026-02-13T20:16:29.117 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:306: TEST_divergent_ec: echo 'bringing up non_divergent 0 2' 2026-02-13T20:16:29.117 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:307: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T20:16:29.329 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:16:29.329 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 stale+active+clean 2026-02-13T20:15:59.795619+0000 28'104 28:124 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:15:59.088125+0000 0'0 2026-02-13T20:15:59.088125+0000 0 0 periodic scrub scheduled @ 2026-02-14T23:42:42.184504+0000 0 0 2026-02-13T20:16:29.329 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:16:29.329 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:16:29.330 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:16:29.341 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:308: TEST_divergent_ec: for i in $non_divergent 2026-02-13T20:16:29.341 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:310: TEST_divergent_ec: activate_osd td/divergent-priors 0 2026-02-13T20:16:29.341 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T20:16:29.341 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T20:16:29.341 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-13T20:16:29.341 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T20:16:29.341 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-13T20:16:29.341 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:16:29.341 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:16:29.341 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:16:29.341 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:16:29.341 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-13T20:16:29.341 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-13T20:16:29.341 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T20:16:29.341 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T20:16:29.341 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:16:29.341 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T20:16:29.341 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:16:29.341 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:16:29.342 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:16:29.342 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:16:29.342 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:16:29.342 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:16:29.342 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:16:29.342 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:16:29.342 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:16:29.342 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:16:29.342 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:16:29.342 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:16:29.342 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:16:29.343 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:16:29.343 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T20:16:29.343 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T20:16:29.343 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-13T20:16:29.343 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-13T20:16:29.344 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-13T20:16:29.344 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:16:29.344 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-13T20:16:29.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-13T20:16:29.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T20:16:29.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T20:16:29.346 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T20:16:29.367 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:16:29.362+0000 7f9195cf0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:16:29.368 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:16:29.366+0000 7f9195cf0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:16:29.369 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:16:29.366+0000 7f9195cf0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:16:29.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-13T20:16:29.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:16:29.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T20:16:29.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:16:29.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:16:29.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:16:29.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:16:29.566 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:16:29.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:16:29.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:16:29.781 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:16:29.822 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:16:29.818+0000 7f9195cf0a40 -1 Falling back to public interface 2026-02-13T20:16:30.470 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:16:30.466+0000 7f9195cf0a40 -1 osd.0 27 log_to_monitors true 2026-02-13T20:16:30.783 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:16:30.783 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:16:30.783 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:16:30.783 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:16:30.784 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:16:30.784 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:16:31.003 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up out weight 0 up_from 35 up_thru 0 down_at 29 last_clean_interval [5,27) [v2:127.0.0.1:6800/1554368689,v1:127.0.0.1:6801/1554368689] [v2:127.0.0.1:6802/1554368689,v1:127.0.0.1:6803/1554368689] exists,up f07a9a5d-5587-496d-ae5a-150352e2c1fc 2026-02-13T20:16:31.006 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:16:31.006 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:16:31.007 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:16:31.007 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:308: TEST_divergent_ec: for i in $non_divergent 2026-02-13T20:16:31.007 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:310: TEST_divergent_ec: activate_osd td/divergent-priors 2 2026-02-13T20:16:31.007 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T20:16:31.007 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T20:16:31.007 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T20:16:31.007 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T20:16:31.007 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-13T20:16:31.007 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:16:31.007 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:16:31.007 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:16:31.008 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:16:31.008 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-13T20:16:31.008 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-13T20:16:31.008 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T20:16:31.008 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T20:16:31.008 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:16:31.008 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T20:16:31.008 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:16:31.008 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:16:31.008 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:16:31.008 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:16:31.008 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:16:31.008 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:16:31.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:16:31.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:16:31.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:16:31.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:16:31.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:16:31.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:16:31.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:16:31.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:16:31.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T20:16:31.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T20:16:31.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-13T20:16:31.010 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-13T20:16:31.011 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T20:16:31.011 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:16:31.011 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-13T20:16:31.011 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T20:16:31.011 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T20:16:31.011 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T20:16:31.011 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T20:16:31.033 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:16:31.030+0000 7f3c41237a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:16:31.034 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:16:31.030+0000 7f3c41237a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:16:31.035 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:16:31.030+0000 7f3c41237a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:16:31.224 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T20:16:31.225 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:16:31.225 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T20:16:31.225 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:16:31.225 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:16:31.225 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:16:31.225 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:16:31.226 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:16:31.226 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:16:31.226 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:16:31.442 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:16:31.438+0000 7f3c41237a40 -1 Falling back to public interface 2026-02-13T20:16:31.446 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:16:32.082 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:16:32.078+0000 7f3c41237a40 -1 osd.2 27 log_to_monitors true 2026-02-13T20:16:32.447 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:16:32.447 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:16:32.448 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:16:32.449 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:16:32.449 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:16:32.449 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:16:32.667 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up out weight 0 up_from 38 up_thru 0 down_at 31 last_clean_interval [14,27) [v2:127.0.0.1:6810/4222706056,v1:127.0.0.1:6811/4222706056] [v2:127.0.0.1:6812/4222706056,v1:127.0.0.1:6813/4222706056] exists,up 3a006542-89c5-41a2-bd52-742aba707d2e 2026-02-13T20:16:32.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:16:32.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:16:32.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:16:32.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:312: TEST_divergent_ec: for i in $non_divergent 2026-02-13T20:16:32.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:314: TEST_divergent_ec: ceph osd in osd.0 2026-02-13T20:16:32.914 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already in. 2026-02-13T20:16:32.925 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:312: TEST_divergent_ec: for i in $non_divergent 2026-02-13T20:16:32.926 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:314: TEST_divergent_ec: ceph osd in osd.2 2026-02-13T20:16:33.220 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already in. 2026-02-13T20:16:33.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:317: TEST_divergent_ec: sleep 5 2026-02-13T20:16:38.232 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:321: TEST_divergent_ec: expr 2 + 2 2026-02-13T20:16:38.233 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:321: TEST_divergent_ec: objname=existing_4 2026-02-13T20:16:38.234 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:322: TEST_divergent_ec: echo 'writing non-divergent object existing_4' 2026-02-13T20:16:38.234 INFO:tasks.workunit.client.0.trial030.stdout:writing non-divergent object existing_4 2026-02-13T20:16:38.234 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:323: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T20:16:38.434 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:16:38.434 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-13T20:16:33.265811+0000 27'100 42:128 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-13T20:15:59.088125+0000 0'0 2026-02-13T20:15:59.088125+0000 0 0 periodic scrub scheduled @ 2026-02-14T20:55:32.642843+0000 0 0 2026-02-13T20:16:38.434 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:16:38.434 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:16:38.435 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:16:38.443 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:324: TEST_divergent_ec: rados -p test put existing_4 /tmp/tmp.eC5mlpjQbo 2026-02-13T20:16:38.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:325: TEST_divergent_ec: rm -f /tmp/tmp.eC5mlpjQbo 2026-02-13T20:16:38.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-13T20:16:38.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: wait_for_clean 2026-02-13T20:16:38.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T20:16:38.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T20:16:38.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T20:16:38.477 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-13T20:16:38.477 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T20:16:38.477 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T20:16:38.477 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T20:16:38.477 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T20:16:38.478 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T20:16:38.551 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-13T20:16:38.551 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T20:16:38.551 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T20:16:38.551 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T20:16:38.551 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T20:16:38.551 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T20:16:38.761 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T20:16:38.762 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:16:38.762 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:16:38.762 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T20:16:38.762 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:16:38.763 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-13T20:16:38.849 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855364 2026-02-13T20:16:38.849 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855364 2026-02-13T20:16:38.849 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855364' 2026-02-13T20:16:38.849 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:16:38.849 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-13T20:16:38.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-13T20:16:38.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-13T20:16:38.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-13T20:16:38.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-13T20:16:38.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:16:38.913 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-13T20:16:38.993 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757252 2026-02-13T20:16:38.993 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757252 2026-02-13T20:16:38.993 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855364 2-163208757252' 2026-02-13T20:16:38.993 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:16:38.993 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855364 2026-02-13T20:16:38.993 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:16:38.994 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-13T20:16:38.995 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855364 2026-02-13T20:16:38.995 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:16:38.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855364 2026-02-13T20:16:38.997 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 150323855364 2026-02-13T20:16:38.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855364' 2026-02-13T20:16:38.997 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:16:39.209 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855362 -lt 150323855364 2026-02-13T20:16:39.209 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:16:40.210 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T20:16:40.210 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:16:40.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855364 -lt 150323855364 2026-02-13T20:16:40.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:16:40.427 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-163208757252 2026-02-13T20:16:40.428 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:16:40.428 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-13T20:16:40.429 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-163208757252 2026-02-13T20:16:40.429 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:16:40.431 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757252 2026-02-13T20:16:40.431 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 163208757252 2026-02-13T20:16:40.431 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 163208757252' 2026-02-13T20:16:40.432 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:16:40.654 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757252 -lt 163208757252 2026-02-13T20:16:40.654 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T20:16:40.655 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:16:40.655 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:16:40.938 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T20:16:40.938 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:16:40.938 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:16:40.938 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:16:40.938 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:16:40.939 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:16:40.939 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:16:40.939 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:16:41.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:16:41.148 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:16:41.148 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:16:41.149 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:16:41.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:16:41.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-13T20:16:41.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-13T20:16:41.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-13T20:16:41.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:16:41.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-13T20:16:41.525 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:16:41.525 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:16:41.526 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:16:41.526 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:16:41.526 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:16:41.526 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:16:41.526 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:16:41.526 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:16:41.735 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:16:41.736 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:16:41.737 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:16:41.737 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:16:42.014 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:16:42.014 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:16:42.014 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:16:42.014 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:16:42.014 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:16:42.014 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:16:42.014 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:16:42.014 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:16:42.014 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:16:42.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:16:42.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:16:42.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-13T20:16:42.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:16:42.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-13T20:16:42.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:16:42.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:16:42.493 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:16:42.494 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:16:42.494 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:16:42.494 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:16:42.494 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:16:42.494 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:16:42.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:16:42.701 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:16:42.702 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:16:42.702 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:16:42.995 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:16:42.995 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:16:42.995 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:16:42.995 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:16:42.995 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:16:42.995 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:16:42.995 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:16:42.995 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:16:42.996 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:16:43.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:16:43.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:16:43.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-13T20:16:43.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:16:43.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-13T20:16:43.691 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:16:43.691 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:16:43.692 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:16:43.692 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:16:43.692 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:16:43.692 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:16:43.692 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:16:43.692 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:16:43.909 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:16:43.909 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:16:43.909 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:16:43.909 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:16:44.206 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:16:44.206 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:16:44.206 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:16:44.206 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:16:44.206 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:16:44.206 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:16:44.206 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:16:44.207 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:16:44.207 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:16:44.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:16:44.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:16:44.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-13T20:16:44.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:16:44.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-13T20:16:45.299 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:16:45.299 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:16:45.299 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:16:45.299 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:16:45.299 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:16:45.299 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:16:45.300 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:16:45.300 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:16:45.509 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:16:45.510 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:16:45.510 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:16:45.510 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:16:45.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:16:45.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:16:45.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:16:45.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:16:45.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:16:45.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:16:45.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:16:45.805 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:16:45.806 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:16:46.099 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:16:46.099 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:16:46.099 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-13T20:16:46.099 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:16:46.099 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-13T20:16:47.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:16:47.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:16:47.701 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:16:47.701 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:16:47.701 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:16:47.701 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:16:47.701 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:16:47.701 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:16:47.920 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:16:47.920 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:16:47.921 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:16:47.921 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:16:48.209 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:16:48.209 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:16:48.209 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:16:48.209 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:16:48.209 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:16:48.209 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:16:48.209 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:16:48.209 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:16:48.209 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:16:48.503 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:16:48.503 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:16:48.503 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-13T20:16:48.504 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:16:48.504 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-13T20:16:51.705 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:16:51.705 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:16:51.705 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:16:51.705 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:16:51.705 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:16:51.705 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:16:51.706 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:16:51.706 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:16:51.917 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:16:51.917 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:16:51.918 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:16:51.918 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:16:52.203 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:16:52.203 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:16:52.203 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:16:52.203 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:16:52.203 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:16:52.203 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:16:52.203 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:16:52.203 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:16:52.203 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:16:52.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:16:52.494 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:16:52.494 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-13T20:16:52.494 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:16:52.494 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-13T20:16:58.895 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:16:58.895 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:16:58.896 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:16:58.896 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:16:58.896 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:16:58.896 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:16:58.897 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:16:58.897 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:16:59.106 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:16:59.106 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:16:59.107 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:16:59.107 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:16:59.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:16:59.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:16:59.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:16:59.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:16:59.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:16:59.400 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:16:59.400 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:16:59.400 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:16:59.400 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:16:59.691 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:16:59.691 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:16:59.691 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-13T20:16:59.691 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:16:59.691 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-13T20:17:06.991 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:17:06.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:17:06.993 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:17:06.993 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:17:06.993 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:17:06.993 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:17:06.993 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:17:06.993 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:17:07.208 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:17:07.208 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:17:07.209 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:17:07.209 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:17:07.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:17:07.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:17:07.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:17:07.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:17:07.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:17:07.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:17:07.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:17:07.493 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:17:07.493 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:17:07.774 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:17:07.775 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:17:07.775 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-13T20:17:07.775 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-13T20:17:08.062 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-13T20:17:08.062 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_fingerprint": "7608e7ee-f1af-44f1-a372-f78a91726508", 2026-02-13T20:17:08.062 INFO:tasks.workunit.client.0.trial030.stdout: "version": "20.3.0-5230-gafefaa40", 2026-02-13T20:17:08.063 INFO:tasks.workunit.client.0.trial030.stdout: "commit": "afefaa40503a4bf024e96f97dd7f852b75f00ad6", 2026-02-13T20:17:08.063 INFO:tasks.workunit.client.0.trial030.stdout: "timestamp": "2026-02-13T20:17:08.061232+0000", 2026-02-13T20:17:08.063 INFO:tasks.workunit.client.0.trial030.stdout: "tag": "", 2026-02-13T20:17:08.063 INFO:tasks.workunit.client.0.trial030.stdout: "health": { 2026-02-13T20:17:08.063 INFO:tasks.workunit.client.0.trial030.stdout: "status": "HEALTH_WARN", 2026-02-13T20:17:08.063 INFO:tasks.workunit.client.0.trial030.stdout: "checks": { 2026-02-13T20:17:08.063 INFO:tasks.workunit.client.0.trial030.stdout: "OSDMAP_FLAGS": { 2026-02-13T20:17:08.063 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-13T20:17:08.063 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-13T20:17:08.063 INFO:tasks.workunit.client.0.trial030.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-13T20:17:08.063 INFO:tasks.workunit.client.0.trial030.stdout: "count": 17 2026-02-13T20:17:08.064 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.064 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [], 2026-02-13T20:17:08.064 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-13T20:17:08.064 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.064 INFO:tasks.workunit.client.0.trial030.stdout: "OSD_DOWN": { 2026-02-13T20:17:08.064 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-13T20:17:08.064 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-13T20:17:08.064 INFO:tasks.workunit.client.0.trial030.stdout: "message": "1 osds down", 2026-02-13T20:17:08.064 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-13T20:17:08.064 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.064 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-13T20:17:08.064 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.065 INFO:tasks.workunit.client.0.trial030.stdout: "message": "osd.1 (root=default,host=trial030) is down" 2026-02-13T20:17:08.065 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.065 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:08.065 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-13T20:17:08.065 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.065 INFO:tasks.workunit.client.0.trial030.stdout: "PG_DEGRADED": { 2026-02-13T20:17:08.065 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-13T20:17:08.065 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-13T20:17:08.065 INFO:tasks.workunit.client.0.trial030.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2026-02-13T20:17:08.065 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-13T20:17:08.065 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.065 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-13T20:17:08.066 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.066 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [NONE,0,2]" 2026-02-13T20:17:08.066 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.066 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:08.066 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-13T20:17:08.066 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.066 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.066 INFO:tasks.workunit.client.0.trial030.stdout: "mutes": [] 2026-02-13T20:17:08.066 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.066 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_first_committed": 1, 2026-02-13T20:17:08.066 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_last_committed": 1, 2026-02-13T20:17:08.067 INFO:tasks.workunit.client.0.trial030.stdout: "monmap": { 2026-02-13T20:17:08.067 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-13T20:17:08.067 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "76a1de22-3326-43d1-82f4-48cedec81b31", 2026-02-13T20:17:08.067 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-13T20:15:46.671477Z", 2026-02-13T20:17:08.067 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-13T20:15:46.671477Z", 2026-02-13T20:17:08.067 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release": 20, 2026-02-13T20:17:08.067 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:17:08.068 INFO:tasks.workunit.client.0.trial030.stdout: "election_strategy": 1, 2026-02-13T20:17:08.068 INFO:tasks.workunit.client.0.trial030.stdout: "disallowed_leaders": "", 2026-02-13T20:17:08.068 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": false, 2026-02-13T20:17:08.068 INFO:tasks.workunit.client.0.trial030.stdout: "tiebreaker_mon": "", 2026-02-13T20:17:08.068 INFO:tasks.workunit.client.0.trial030.stdout: "removed_ranks": "", 2026-02-13T20:17:08.068 INFO:tasks.workunit.client.0.trial030.stdout: "features": { 2026-02-13T20:17:08.069 INFO:tasks.workunit.client.0.trial030.stdout: "persistent": [ 2026-02-13T20:17:08.069 INFO:tasks.workunit.client.0.trial030.stdout: "kraken", 2026-02-13T20:17:08.069 INFO:tasks.workunit.client.0.trial030.stdout: "luminous", 2026-02-13T20:17:08.069 INFO:tasks.workunit.client.0.trial030.stdout: "mimic", 2026-02-13T20:17:08.069 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap-prune", 2026-02-13T20:17:08.069 INFO:tasks.workunit.client.0.trial030.stdout: "nautilus", 2026-02-13T20:17:08.070 INFO:tasks.workunit.client.0.trial030.stdout: "octopus", 2026-02-13T20:17:08.070 INFO:tasks.workunit.client.0.trial030.stdout: "pacific", 2026-02-13T20:17:08.070 INFO:tasks.workunit.client.0.trial030.stdout: "elector-pinging", 2026-02-13T20:17:08.070 INFO:tasks.workunit.client.0.trial030.stdout: "quincy", 2026-02-13T20:17:08.070 INFO:tasks.workunit.client.0.trial030.stdout: "reef", 2026-02-13T20:17:08.070 INFO:tasks.workunit.client.0.trial030.stdout: "squid", 2026-02-13T20:17:08.070 INFO:tasks.workunit.client.0.trial030.stdout: "tentacle", 2026-02-13T20:17:08.070 INFO:tasks.workunit.client.0.trial030.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:08.070 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:08.070 INFO:tasks.workunit.client.0.trial030.stdout: "optional": [] 2026-02-13T20:17:08.070 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.071 INFO:tasks.workunit.client.0.trial030.stdout: "mons": [ 2026-02-13T20:17:08.071 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.071 INFO:tasks.workunit.client.0.trial030.stdout: "rank": 0, 2026-02-13T20:17:08.071 INFO:tasks.workunit.client.0.trial030.stdout: "name": "a", 2026-02-13T20:17:08.071 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:17:08.071 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:08.071 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.071 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:08.071 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115", 2026-02-13T20:17:08.071 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 0 2026-02-13T20:17:08.071 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.071 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.072 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.072 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115/0", 2026-02-13T20:17:08.072 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-13T20:17:08.072 INFO:tasks.workunit.client.0.trial030.stdout: "priority": 0, 2026-02-13T20:17:08.072 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 0, 2026-02-13T20:17:08.072 INFO:tasks.workunit.client.0.trial030.stdout: "time_added": "2026-02-13T20:15:46:671475+0000", 2026-02-13T20:17:08.072 INFO:tasks.workunit.client.0.trial030.stdout: "crush_location": [] 2026-02-13T20:17:08.072 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.072 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.072 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.072 INFO:tasks.workunit.client.0.trial030.stdout: "quorum": [ 2026-02-13T20:17:08.072 INFO:tasks.workunit.client.0.trial030.stdout: 0 2026-02-13T20:17:08.073 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:08.073 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap": { 2026-02-13T20:17:08.073 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 42, 2026-02-13T20:17:08.073 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "76a1de22-3326-43d1-82f4-48cedec81b31", 2026-02-13T20:17:08.073 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-13T20:15:46.746126+0000", 2026-02-13T20:17:08.073 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-13T20:16:33.262270+0000", 2026-02-13T20:17:08.073 INFO:tasks.workunit.client.0.trial030.stdout: "last_up_change": "2026-02-13T20:16:32.225608+0000", 2026-02-13T20:17:08.073 INFO:tasks.workunit.client.0.trial030.stdout: "last_in_change": "2026-02-13T20:16:33.160113+0000", 2026-02-13T20:17:08.073 INFO:tasks.workunit.client.0.trial030.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-13T20:17:08.073 INFO:tasks.workunit.client.0.trial030.stdout: "flags_num": 5800384, 2026-02-13T20:17:08.073 INFO:tasks.workunit.client.0.trial030.stdout: "flags_set": [ 2026-02-13T20:17:08.073 INFO:tasks.workunit.client.0.trial030.stdout: "nodown", 2026-02-13T20:17:08.074 INFO:tasks.workunit.client.0.trial030.stdout: "noin", 2026-02-13T20:17:08.074 INFO:tasks.workunit.client.0.trial030.stdout: "noout", 2026-02-13T20:17:08.074 INFO:tasks.workunit.client.0.trial030.stdout: "pglog_hardlimit", 2026-02-13T20:17:08.074 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snapdirs", 2026-02-13T20:17:08.074 INFO:tasks.workunit.client.0.trial030.stdout: "recovery_deletes", 2026-02-13T20:17:08.074 INFO:tasks.workunit.client.0.trial030.stdout: "sortbitwise" 2026-02-13T20:17:08.074 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:08.074 INFO:tasks.workunit.client.0.trial030.stdout: "crush_version": 10, 2026-02-13T20:17:08.074 INFO:tasks.workunit.client.0.trial030.stdout: "full_ratio": 0.99000000953674316, 2026-02-13T20:17:08.074 INFO:tasks.workunit.client.0.trial030.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-13T20:17:08.074 INFO:tasks.workunit.client.0.trial030.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-13T20:17:08.074 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_snapshot": "", 2026-02-13T20:17:08.074 INFO:tasks.workunit.client.0.trial030.stdout: "pool_max": 1, 2026-02-13T20:17:08.075 INFO:tasks.workunit.client.0.trial030.stdout: "max_osd": 3, 2026-02-13T20:17:08.075 INFO:tasks.workunit.client.0.trial030.stdout: "require_min_compat_client": "luminous", 2026-02-13T20:17:08.075 INFO:tasks.workunit.client.0.trial030.stdout: "min_compat_client": "jewel", 2026-02-13T20:17:08.075 INFO:tasks.workunit.client.0.trial030.stdout: "require_osd_release": "tentacle", 2026-02-13T20:17:08.075 INFO:tasks.workunit.client.0.trial030.stdout: "allow_crimson": false, 2026-02-13T20:17:08.075 INFO:tasks.workunit.client.0.trial030.stdout: "pools": [ 2026-02-13T20:17:08.075 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.075 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-13T20:17:08.075 INFO:tasks.workunit.client.0.trial030.stdout: "pool_name": "test", 2026-02-13T20:17:08.075 INFO:tasks.workunit.client.0.trial030.stdout: "create_time": "2026-02-13T20:15:58.996476+0000", 2026-02-13T20:17:08.075 INFO:tasks.workunit.client.0.trial030.stdout: "flags": 16389, 2026-02-13T20:17:08.075 INFO:tasks.workunit.client.0.trial030.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2026-02-13T20:17:08.076 INFO:tasks.workunit.client.0.trial030.stdout: "type": 3, 2026-02-13T20:17:08.076 INFO:tasks.workunit.client.0.trial030.stdout: "size": 3, 2026-02-13T20:17:08.076 INFO:tasks.workunit.client.0.trial030.stdout: "min_size": 2, 2026-02-13T20:17:08.076 INFO:tasks.workunit.client.0.trial030.stdout: "crush_rule": 1, 2026-02-13T20:17:08.076 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_count": 0, 2026-02-13T20:17:08.076 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_target": 0, 2026-02-13T20:17:08.076 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_barrier": 0, 2026-02-13T20:17:08.076 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-13T20:17:08.076 INFO:tasks.workunit.client.0.trial030.stdout: "is_stretch_pool": false, 2026-02-13T20:17:08.076 INFO:tasks.workunit.client.0.trial030.stdout: "object_hash": 2, 2026-02-13T20:17:08.076 INFO:tasks.workunit.client.0.trial030.stdout: "pg_autoscale_mode": "off", 2026-02-13T20:17:08.076 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num": 1, 2026-02-13T20:17:08.076 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num": 1, 2026-02-13T20:17:08.077 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num_target": 1, 2026-02-13T20:17:08.077 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_target": 1, 2026-02-13T20:17:08.077 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_pending": 1, 2026-02-13T20:17:08.077 INFO:tasks.workunit.client.0.trial030.stdout: "last_pg_merge_meta": { 2026-02-13T20:17:08.077 INFO:tasks.workunit.client.0.trial030.stdout: "source_pgid": "0.0", 2026-02-13T20:17:08.077 INFO:tasks.workunit.client.0.trial030.stdout: "ready_epoch": 0, 2026-02-13T20:17:08.077 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_started": 0, 2026-02-13T20:17:08.077 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": 0, 2026-02-13T20:17:08.077 INFO:tasks.workunit.client.0.trial030.stdout: "source_version": "0'0", 2026-02-13T20:17:08.077 INFO:tasks.workunit.client.0.trial030.stdout: "target_version": "0'0" 2026-02-13T20:17:08.077 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.077 INFO:tasks.workunit.client.0.trial030.stdout: "last_change": "28", 2026-02-13T20:17:08.077 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend": "0", 2026-02-13T20:17:08.078 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-13T20:17:08.078 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_preluminous": "0", 2026-02-13T20:17:08.078 INFO:tasks.workunit.client.0.trial030.stdout: "auid": 0, 2026-02-13T20:17:08.078 INFO:tasks.workunit.client.0.trial030.stdout: "snap_mode": "pool", 2026-02-13T20:17:08.078 INFO:tasks.workunit.client.0.trial030.stdout: "snap_seq": 1, 2026-02-13T20:17:08.078 INFO:tasks.workunit.client.0.trial030.stdout: "snap_epoch": 28, 2026-02-13T20:17:08.078 INFO:tasks.workunit.client.0.trial030.stdout: "pool_snaps": [ 2026-02-13T20:17:08.078 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.078 INFO:tasks.workunit.client.0.trial030.stdout: "snapid": 1, 2026-02-13T20:17:08.078 INFO:tasks.workunit.client.0.trial030.stdout: "stamp": "2026-02-13T20:16:17.250846+0000", 2026-02-13T20:17:08.078 INFO:tasks.workunit.client.0.trial030.stdout: "name": "snap1" 2026-02-13T20:17:08.078 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.078 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:08.079 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps": "[]", 2026-02-13T20:17:08.079 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_bytes": 0, 2026-02-13T20:17:08.079 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_objects": 0, 2026-02-13T20:17:08.079 INFO:tasks.workunit.client.0.trial030.stdout: "tiers": [], 2026-02-13T20:17:08.079 INFO:tasks.workunit.client.0.trial030.stdout: "tier_of": -1, 2026-02-13T20:17:08.079 INFO:tasks.workunit.client.0.trial030.stdout: "read_tier": -1, 2026-02-13T20:17:08.079 INFO:tasks.workunit.client.0.trial030.stdout: "write_tier": -1, 2026-02-13T20:17:08.079 INFO:tasks.workunit.client.0.trial030.stdout: "cache_mode": "none", 2026-02-13T20:17:08.079 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_bytes": 0, 2026-02-13T20:17:08.079 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_objects": 0, 2026-02-13T20:17:08.079 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-13T20:17:08.079 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-13T20:17:08.080 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-13T20:17:08.080 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_flush_age": 0, 2026-02-13T20:17:08.080 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_evict_age": 0, 2026-02-13T20:17:08.080 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profile": "myprofile", 2026-02-13T20:17:08.080 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_params": { 2026-02-13T20:17:08.080 INFO:tasks.workunit.client.0.trial030.stdout: "type": "none" 2026-02-13T20:17:08.080 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.080 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_period": 0, 2026-02-13T20:17:08.080 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_count": 0, 2026-02-13T20:17:08.080 INFO:tasks.workunit.client.0.trial030.stdout: "use_gmt_hitset": true, 2026-02-13T20:17:08.080 INFO:tasks.workunit.client.0.trial030.stdout: "min_read_recency_for_promote": 0, 2026-02-13T20:17:08.080 INFO:tasks.workunit.client.0.trial030.stdout: "min_write_recency_for_promote": 0, 2026-02-13T20:17:08.080 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_grade_decay_rate": 0, 2026-02-13T20:17:08.080 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_search_last_n": 0, 2026-02-13T20:17:08.081 INFO:tasks.workunit.client.0.trial030.stdout: "grade_table": [], 2026-02-13T20:17:08.081 INFO:tasks.workunit.client.0.trial030.stdout: "stripe_width": 8192, 2026-02-13T20:17:08.081 INFO:tasks.workunit.client.0.trial030.stdout: "expected_num_objects": 0, 2026-02-13T20:17:08.081 INFO:tasks.workunit.client.0.trial030.stdout: "fast_read": false, 2026-02-13T20:17:08.081 INFO:tasks.workunit.client.0.trial030.stdout: "nonprimary_shards": "{}", 2026-02-13T20:17:08.081 INFO:tasks.workunit.client.0.trial030.stdout: "options": {}, 2026-02-13T20:17:08.081 INFO:tasks.workunit.client.0.trial030.stdout: "application_metadata": {} 2026-02-13T20:17:08.081 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.081 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:08.081 INFO:tasks.workunit.client.0.trial030.stdout: "osds": [ 2026-02-13T20:17:08.081 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.081 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:17:08.082 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "f07a9a5d-5587-496d-ae5a-150352e2c1fc", 2026-02-13T20:17:08.082 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-13T20:17:08.082 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-13T20:17:08.082 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-13T20:17:08.082 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-13T20:17:08.082 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 5, 2026-02-13T20:17:08.082 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 27, 2026-02-13T20:17:08.082 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 35, 2026-02-13T20:17:08.082 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 41, 2026-02-13T20:17:08.082 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 29, 2026-02-13T20:17:08.082 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-13T20:17:08.082 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:17:08.082 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:08.083 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.083 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:08.083 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6800", 2026-02-13T20:17:08.083 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1554368689 2026-02-13T20:17:08.083 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.083 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.083 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:08.083 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6801", 2026-02-13T20:17:08.083 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1554368689 2026-02-13T20:17:08.083 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.083 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.083 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.084 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-13T20:17:08.084 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:08.084 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.084 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:08.084 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6802", 2026-02-13T20:17:08.084 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1554368689 2026-02-13T20:17:08.084 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.084 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.084 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:08.084 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6803", 2026-02-13T20:17:08.084 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1554368689 2026-02-13T20:17:08.084 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.084 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.085 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.085 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-13T20:17:08.085 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:08.085 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.085 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:08.085 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6806", 2026-02-13T20:17:08.085 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1554368689 2026-02-13T20:17:08.085 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.085 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.085 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:08.085 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6807", 2026-02-13T20:17:08.085 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1554368689 2026-02-13T20:17:08.085 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.086 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.086 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.086 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-13T20:17:08.086 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:08.086 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.086 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:08.086 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6804", 2026-02-13T20:17:08.086 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1554368689 2026-02-13T20:17:08.086 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.086 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.086 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:08.086 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6805", 2026-02-13T20:17:08.087 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1554368689 2026-02-13T20:17:08.087 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.087 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.087 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.087 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6801/1554368689", 2026-02-13T20:17:08.087 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6803/1554368689", 2026-02-13T20:17:08.087 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6807/1554368689", 2026-02-13T20:17:08.087 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6805/1554368689", 2026-02-13T20:17:08.087 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-13T20:17:08.087 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-13T20:17:08.087 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-13T20:17:08.087 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.087 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.088 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.088 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:17:08.088 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "c7c6b311-7783-4c87-a03d-8e96a204ca78", 2026-02-13T20:17:08.088 INFO:tasks.workunit.client.0.trial030.stdout: "up": 0, 2026-02-13T20:17:08.088 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-13T20:17:08.088 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-13T20:17:08.088 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-13T20:17:08.088 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 0, 2026-02-13T20:17:08.088 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 0, 2026-02-13T20:17:08.088 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 9, 2026-02-13T20:17:08.088 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 23, 2026-02-13T20:17:08.088 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 30, 2026-02-13T20:17:08.088 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-13T20:17:08.088 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:17:08.089 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:08.089 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.089 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:08.089 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-13T20:17:08.089 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1652690354 2026-02-13T20:17:08.089 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.089 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.089 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:08.089 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-13T20:17:08.089 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1652690354 2026-02-13T20:17:08.089 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.089 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.089 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.090 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-13T20:17:08.090 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:08.090 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.090 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:08.090 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-13T20:17:08.090 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1652690354 2026-02-13T20:17:08.090 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.091 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.091 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:08.091 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-13T20:17:08.091 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1652690354 2026-02-13T20:17:08.091 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.091 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.091 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.091 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-13T20:17:08.091 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:08.091 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.091 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:08.091 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-13T20:17:08.091 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1652690354 2026-02-13T20:17:08.092 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.092 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.092 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:08.092 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-13T20:17:08.092 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1652690354 2026-02-13T20:17:08.092 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.092 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.092 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.093 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-13T20:17:08.093 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:08.093 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.093 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:08.093 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-13T20:17:08.093 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1652690354 2026-02-13T20:17:08.093 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.093 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.094 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:08.094 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-13T20:17:08.094 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1652690354 2026-02-13T20:17:08.094 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.094 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.094 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.094 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/1652690354", 2026-02-13T20:17:08.094 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/1652690354", 2026-02-13T20:17:08.094 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1652690354", 2026-02-13T20:17:08.094 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1652690354", 2026-02-13T20:17:08.094 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-13T20:17:08.094 INFO:tasks.workunit.client.0.trial030.stdout: "exists" 2026-02-13T20:17:08.094 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.094 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.095 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.095 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:17:08.095 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "3a006542-89c5-41a2-bd52-742aba707d2e", 2026-02-13T20:17:08.095 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-13T20:17:08.095 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-13T20:17:08.095 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-13T20:17:08.095 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-13T20:17:08.095 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 14, 2026-02-13T20:17:08.095 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 27, 2026-02-13T20:17:08.095 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 38, 2026-02-13T20:17:08.095 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 0, 2026-02-13T20:17:08.095 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 31, 2026-02-13T20:17:08.095 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-13T20:17:08.095 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:17:08.095 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:08.095 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.096 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:08.096 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-13T20:17:08.096 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4222706056 2026-02-13T20:17:08.096 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.096 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.096 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:08.096 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-13T20:17:08.096 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4222706056 2026-02-13T20:17:08.096 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.096 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.096 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.096 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-13T20:17:08.096 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:08.096 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.096 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:08.096 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-13T20:17:08.096 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4222706056 2026-02-13T20:17:08.096 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.097 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.097 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:08.097 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-13T20:17:08.097 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4222706056 2026-02-13T20:17:08.097 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.097 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.097 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.097 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-13T20:17:08.097 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:08.097 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.097 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:08.097 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-13T20:17:08.097 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4222706056 2026-02-13T20:17:08.097 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.097 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.097 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:08.097 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-13T20:17:08.097 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4222706056 2026-02-13T20:17:08.098 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.098 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.098 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.098 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-13T20:17:08.098 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:08.098 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.098 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:08.098 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-13T20:17:08.098 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4222706056 2026-02-13T20:17:08.098 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.098 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.098 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:08.098 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-13T20:17:08.098 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4222706056 2026-02-13T20:17:08.098 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.098 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.098 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.098 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/4222706056", 2026-02-13T20:17:08.099 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/4222706056", 2026-02-13T20:17:08.099 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/4222706056", 2026-02-13T20:17:08.099 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/4222706056", 2026-02-13T20:17:08.099 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-13T20:17:08.099 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-13T20:17:08.099 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-13T20:17:08.099 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.099 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.099 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:08.099 INFO:tasks.workunit.client.0.trial030.stdout: "osd_xinfo": [ 2026-02-13T20:17:08.099 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.099 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:17:08.099 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-13T20:16:27.927007+0000", 2026-02-13T20:17:08.099 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-13T20:17:08.099 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-13T20:17:08.099 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-13T20:17:08.099 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-13T20:17:08.100 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-13T20:15:50.522788+0000", 2026-02-13T20:17:08.100 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-13T20:17:08.100 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.100 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.100 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:17:08.100 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-13T20:16:28.209541+0000", 2026-02-13T20:17:08.100 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-13T20:17:08.100 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-13T20:17:08.100 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-13T20:17:08.100 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-13T20:17:08.100 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-13T20:15:53.937861+0000", 2026-02-13T20:17:08.100 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-13T20:17:08.100 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.100 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.100 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:17:08.100 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-13T20:16:28.484066+0000", 2026-02-13T20:17:08.100 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-13T20:17:08.101 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-13T20:17:08.101 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-13T20:17:08.101 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-13T20:17:08.101 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-13T20:15:57.994611+0000", 2026-02-13T20:17:08.101 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-13T20:17:08.101 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.101 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:08.101 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap": [], 2026-02-13T20:17:08.101 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_items": [], 2026-02-13T20:17:08.101 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_primaries": [], 2026-02-13T20:17:08.101 INFO:tasks.workunit.client.0.trial030.stdout: "pg_temp": [], 2026-02-13T20:17:08.101 INFO:tasks.workunit.client.0.trial030.stdout: "primary_temp": [], 2026-02-13T20:17:08.101 INFO:tasks.workunit.client.0.trial030.stdout: "blocklist": {}, 2026-02-13T20:17:08.101 INFO:tasks.workunit.client.0.trial030.stdout: "range_blocklist": {}, 2026-02-13T20:17:08.101 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profiles": { 2026-02-13T20:17:08.101 INFO:tasks.workunit.client.0.trial030.stdout: "default": { 2026-02-13T20:17:08.101 INFO:tasks.workunit.client.0.trial030.stdout: "k": "2", 2026-02-13T20:17:08.101 INFO:tasks.workunit.client.0.trial030.stdout: "m": "2", 2026-02-13T20:17:08.101 INFO:tasks.workunit.client.0.trial030.stdout: "plugin": "isa", 2026-02-13T20:17:08.101 INFO:tasks.workunit.client.0.trial030.stdout: "technique": "reed_sol_van" 2026-02-13T20:17:08.102 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.102 INFO:tasks.workunit.client.0.trial030.stdout: "myprofile": { 2026-02-13T20:17:08.102 INFO:tasks.workunit.client.0.trial030.stdout: "crush-device-class": "", 2026-02-13T20:17:08.102 INFO:tasks.workunit.client.0.trial030.stdout: "crush-failure-domain": "osd", 2026-02-13T20:17:08.102 INFO:tasks.workunit.client.0.trial030.stdout: "crush-num-failure-domains": "0", 2026-02-13T20:17:08.102 INFO:tasks.workunit.client.0.trial030.stdout: "crush-osds-per-failure-domain": "0", 2026-02-13T20:17:08.102 INFO:tasks.workunit.client.0.trial030.stdout: "crush-root": "default", 2026-02-13T20:17:08.102 INFO:tasks.workunit.client.0.trial030.stdout: "k": "2", 2026-02-13T20:17:08.102 INFO:tasks.workunit.client.0.trial030.stdout: "m": "1", 2026-02-13T20:17:08.102 INFO:tasks.workunit.client.0.trial030.stdout: "plugin": "isa", 2026-02-13T20:17:08.102 INFO:tasks.workunit.client.0.trial030.stdout: "technique": "reed_sol_van" 2026-02-13T20:17:08.102 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.102 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.102 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps_queue": [], 2026-02-13T20:17:08.102 INFO:tasks.workunit.client.0.trial030.stdout: "new_removed_snaps": [], 2026-02-13T20:17:08.102 INFO:tasks.workunit.client.0.trial030.stdout: "new_purged_snaps": [], 2026-02-13T20:17:08.102 INFO:tasks.workunit.client.0.trial030.stdout: "crush_node_flags": {}, 2026-02-13T20:17:08.102 INFO:tasks.workunit.client.0.trial030.stdout: "device_class_flags": {}, 2026-02-13T20:17:08.102 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": { 2026-02-13T20:17:08.103 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_enabled": false, 2026-02-13T20:17:08.103 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_bucket_count": 0, 2026-02-13T20:17:08.103 INFO:tasks.workunit.client.0.trial030.stdout: "degraded_stretch_mode": 0, 2026-02-13T20:17:08.103 INFO:tasks.workunit.client.0.trial030.stdout: "recovering_stretch_mode": 0, 2026-02-13T20:17:08.103 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_bucket": 0 2026-02-13T20:17:08.103 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.103 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.103 INFO:tasks.workunit.client.0.trial030.stdout: "osd_metadata": [ 2026-02-13T20:17:08.103 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.103 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:17:08.103 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-13T20:17:08.103 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6802/1554368689,v1:127.0.0.1:6803/1554368689]", 2026-02-13T20:17:08.103 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-13T20:17:08.103 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-13T20:17:08.103 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-13T20:17:08.103 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T20:17:08.103 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-13T20:17:08.103 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T20:17:08.103 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-13T20:17:08.104 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T20:17:08.104 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T20:17:08.104 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T20:17:08.104 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T20:17:08.104 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T20:17:08.104 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-13T20:17:08.104 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T20:17:08.104 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T20:17:08.104 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T20:17:08.104 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T20:17:08.104 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T20:17:08.104 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T20:17:08.104 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-13T20:17:08.104 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-13T20:17:08.104 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:17:08.104 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-13T20:17:08.104 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:17:08.104 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T20:17:08.104 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-13T20:15:47.740468Z", 2026-02-13T20:17:08.104 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-13T20:17:08.105 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-13T20:17:08.105 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T20:17:08.105 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-13T20:17:08.105 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-13T20:17:08.105 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T20:17:08.105 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-13T20:17:08.105 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6800/1554368689,v1:127.0.0.1:6801/1554368689]", 2026-02-13T20:17:08.105 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-13T20:17:08.105 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/1554368689,v1:127.0.0.1:6807/1554368689]", 2026-02-13T20:17:08.105 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/1554368689,v1:127.0.0.1:6805/1554368689]", 2026-02-13T20:17:08.105 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-13T20:17:08.105 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-13T20:17:08.105 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T20:17:08.105 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T20:17:08.105 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-13T20:17:08.105 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961704", 2026-02-13T20:17:08.105 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T20:17:08.105 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-13T20:17:08.105 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-13T20:17:08.105 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-13T20:17:08.105 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/0", 2026-02-13T20:17:08.105 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-13T20:17:08.106 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-13T20:17:08.106 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-13T20:17:08.106 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.106 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.106 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:17:08.106 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-13T20:17:08.106 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/1652690354,v1:127.0.0.1:6813/1652690354]", 2026-02-13T20:17:08.106 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-13T20:17:08.106 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-13T20:17:08.106 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-13T20:17:08.106 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T20:17:08.106 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-13T20:17:08.106 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T20:17:08.106 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-13T20:17:08.106 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T20:17:08.106 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T20:17:08.106 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T20:17:08.106 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T20:17:08.106 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T20:17:08.106 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-13T20:17:08.107 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T20:17:08.107 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T20:17:08.107 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T20:17:08.107 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T20:17:08.107 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T20:17:08.107 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T20:17:08.107 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-13T20:17:08.107 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-13T20:17:08.107 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:17:08.107 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-13T20:17:08.107 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:17:08.107 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T20:17:08.107 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-13T20:15:51.455689Z", 2026-02-13T20:17:08.107 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-13T20:17:08.107 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-13T20:17:08.107 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T20:17:08.107 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-13T20:17:08.107 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-13T20:17:08.107 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T20:17:08.107 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-13T20:17:08.107 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/1652690354,v1:127.0.0.1:6811/1652690354]", 2026-02-13T20:17:08.107 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-13T20:17:08.108 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1652690354,v1:127.0.0.1:6817/1652690354]", 2026-02-13T20:17:08.108 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1652690354,v1:127.0.0.1:6815/1652690354]", 2026-02-13T20:17:08.108 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-13T20:17:08.108 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-13T20:17:08.108 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T20:17:08.108 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T20:17:08.108 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-13T20:17:08.108 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961704", 2026-02-13T20:17:08.108 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T20:17:08.108 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-13T20:17:08.108 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-13T20:17:08.108 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-13T20:17:08.108 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/1", 2026-02-13T20:17:08.108 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-13T20:17:08.108 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-13T20:17:08.108 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-13T20:17:08.109 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.109 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.109 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:17:08.109 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-13T20:17:08.109 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/4222706056,v1:127.0.0.1:6813/4222706056]", 2026-02-13T20:17:08.109 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-13T20:17:08.109 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-13T20:17:08.109 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-13T20:17:08.109 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T20:17:08.109 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-13T20:17:08.109 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T20:17:08.109 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-13T20:17:08.109 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T20:17:08.109 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T20:17:08.109 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T20:17:08.109 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T20:17:08.109 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T20:17:08.109 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-13T20:17:08.110 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T20:17:08.110 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T20:17:08.110 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T20:17:08.110 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T20:17:08.110 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T20:17:08.110 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T20:17:08.110 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-13T20:17:08.110 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-13T20:17:08.110 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:17:08.110 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-13T20:17:08.110 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:17:08.110 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T20:17:08.110 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-13T20:15:55.560524Z", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/4222706056,v1:127.0.0.1:6811/4222706056]", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/4222706056,v1:127.0.0.1:6817/4222706056]", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/4222706056,v1:127.0.0.1:6815/4222706056]", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961704", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/2", 2026-02-13T20:17:08.111 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-13T20:17:08.112 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-13T20:17:08.112 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-13T20:17:08.112 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.112 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:08.112 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_clean_epochs": { 2026-02-13T20:17:08.112 INFO:tasks.workunit.client.0.trial030.stdout: "min_last_epoch_clean": 0, 2026-02-13T20:17:08.112 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": { 2026-02-13T20:17:08.112 INFO:tasks.workunit.client.0.trial030.stdout: "per_pool": [] 2026-02-13T20:17:08.112 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.112 INFO:tasks.workunit.client.0.trial030.stdout: "osd_epochs": [ 2026-02-13T20:17:08.112 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.112 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:17:08.112 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 35 2026-02-13T20:17:08.112 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.112 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.113 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:17:08.113 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 39 2026-02-13T20:17:08.113 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.113 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.113 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.113 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_first_committed": 1, 2026-02-13T20:17:08.113 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_last_committed": 42, 2026-02-13T20:17:08.113 INFO:tasks.workunit.client.0.trial030.stdout: "crushmap": { 2026-02-13T20:17:08.113 INFO:tasks.workunit.client.0.trial030.stdout: "devices": [ 2026-02-13T20:17:08.113 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.113 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:17:08.113 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.0", 2026-02-13T20:17:08.113 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.1", 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.2", 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: "types": [ 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 0, 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd" 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: "name": "host" 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 2, 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: "name": "chassis" 2026-02-13T20:17:08.114 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 3, 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: "name": "rack" 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 4, 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: "name": "row" 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 5, 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pdu" 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 6, 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pod" 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 7, 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: "name": "room" 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 8, 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: "name": "datacenter" 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.115 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 9, 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: "name": "zone" 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 10, 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: "name": "region" 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: "name": "root" 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: "buckets": [ 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: "id": -1, 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default", 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:17:08.116 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: "id": -2, 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default~ssd", 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030", 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:17:08.117 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030~ssd", 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.118 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: "rules": [ 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: "rule_id": 0, 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: "rule_name": "replicated_rule", 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: "steps": [ 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: "op": "take", 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: "item": -1, 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: "item_name": "default" 2026-02-13T20:17:08.119 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: "op": "choose_firstn", 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: "num": 0, 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: "type": "osd" 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: "op": "emit" 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: "rule_id": 1, 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: "rule_name": "test", 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: "type": 3, 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: "steps": [ 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: "op": "set_chooseleaf_tries", 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: "num": 5 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: "op": "set_choose_tries", 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: "num": 100 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: "op": "take", 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: "item": -1, 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: "item_name": "default" 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.120 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.121 INFO:tasks.workunit.client.0.trial030.stdout: "op": "choose_indep", 2026-02-13T20:17:08.121 INFO:tasks.workunit.client.0.trial030.stdout: "num": 0, 2026-02-13T20:17:08.121 INFO:tasks.workunit.client.0.trial030.stdout: "type": "osd" 2026-02-13T20:17:08.121 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.121 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.121 INFO:tasks.workunit.client.0.trial030.stderr:report 2815308798 2026-02-13T20:17:08.121 INFO:tasks.workunit.client.0.trial030.stdout: "op": "emit" 2026-02-13T20:17:08.121 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.121 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:08.121 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.121 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:08.121 INFO:tasks.workunit.client.0.trial030.stdout: "tunables": { 2026-02-13T20:17:08.121 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_tries": 0, 2026-02-13T20:17:08.121 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_fallback_tries": 0, 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "choose_total_tries": 50, 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_descend_once": 1, 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_vary_r": 1, 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_stable": 1, 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "msr_descents": 100, 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "msr_collision_tries": 100, 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "straw_calc_version": 1, 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "allowed_bucket_algs": 54, 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "profile": "jewel", 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_tunables": 1, 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "legacy_tunables": 0, 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "minimum_required_version": "jewel", 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables": 1, 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables2": 1, 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "has_v2_rules": 1, 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables3": 1, 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "has_v3_rules": 0, 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "has_v4_buckets": 1, 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables5": 1, 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "has_v5_rules": 0, 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "has_msr_rules": 0 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "choose_args": {} 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "fsmap": { 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-13T20:17:08.122 INFO:tasks.workunit.client.0.trial030.stdout: "btime": "2026-02-13T20:15:46:745898+0000", 2026-02-13T20:17:08.123 INFO:tasks.workunit.client.0.trial030.stdout: "default_fscid": -1, 2026-02-13T20:17:08.123 INFO:tasks.workunit.client.0.trial030.stdout: "compat": { 2026-02-13T20:17:08.123 INFO:tasks.workunit.client.0.trial030.stdout: "compat": {}, 2026-02-13T20:17:08.123 INFO:tasks.workunit.client.0.trial030.stdout: "ro_compat": {}, 2026-02-13T20:17:08.123 INFO:tasks.workunit.client.0.trial030.stdout: "incompat": { 2026-02-13T20:17:08.123 INFO:tasks.workunit.client.0.trial030.stdout: "feature_1": "base v0.20", 2026-02-13T20:17:08.123 INFO:tasks.workunit.client.0.trial030.stdout: "feature_2": "client writeable ranges", 2026-02-13T20:17:08.123 INFO:tasks.workunit.client.0.trial030.stdout: "feature_3": "default file layouts on dirs", 2026-02-13T20:17:08.123 INFO:tasks.workunit.client.0.trial030.stdout: "feature_4": "dir inode in separate object", 2026-02-13T20:17:08.123 INFO:tasks.workunit.client.0.trial030.stdout: "feature_5": "mds uses versioned encoding", 2026-02-13T20:17:08.123 INFO:tasks.workunit.client.0.trial030.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-13T20:17:08.123 INFO:tasks.workunit.client.0.trial030.stdout: "feature_8": "no anchor table", 2026-02-13T20:17:08.123 INFO:tasks.workunit.client.0.trial030.stdout: "feature_9": "file layout v2", 2026-02-13T20:17:08.123 INFO:tasks.workunit.client.0.trial030.stdout: "feature_10": "snaprealm v2", 2026-02-13T20:17:08.123 INFO:tasks.workunit.client.0.trial030.stdout: "feature_11": "minor log segments", 2026-02-13T20:17:08.123 INFO:tasks.workunit.client.0.trial030.stdout: "feature_12": "quiesce subvolumes" 2026-02-13T20:17:08.123 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.123 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.123 INFO:tasks.workunit.client.0.trial030.stdout: "feature_flags": { 2026-02-13T20:17:08.123 INFO:tasks.workunit.client.0.trial030.stdout: "enable_multiple": true, 2026-02-13T20:17:08.123 INFO:tasks.workunit.client.0.trial030.stdout: "ever_enabled_multiple": true 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "standbys": [], 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "filesystems": [] 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_first_committed": 1, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_last_committed": 1, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "auth": { 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 5, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_secrets": 3 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 1, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_active": 1, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_unknown": 0, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_osd": 3, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "pool_sum": { 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 52200, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 101, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 1, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 303, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 101, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 101, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 101, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 101, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T20:17:08.124 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 18, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 18, 2026-02-13T20:17:08.125 INFO:tasks.workunit.client.0.trial030.stdout: "up": 3, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 3, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 0 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum": { 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 3, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83908, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2132, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 27, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81700, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488892, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036625408, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2183168, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 1541353, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 28368, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83661104 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.126 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum_by_class": { 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "ssd": { 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 3, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83908, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2132, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 27, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81700, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488892, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036625408, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2183168, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 1541353, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 28368, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83661104 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-13T20:17:08.127 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "pool_stats": [ 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": 1, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 1, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 52200, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 101, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 1, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 303, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 101, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 101, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 101, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 101, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-13T20:17:08.128 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 1241088, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 1241088, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 18, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 18, 2026-02-13T20:17:08.129 INFO:tasks.workunit.client.0.trial030.stdout: "up": 3, 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 3, 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 3 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: "osd_stats": [ 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 150323855370 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 38654705679 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 163208757258 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_state": [ 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: "state": "active+undersized+degraded", 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: "num": 1 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: "pool_pg_unavailable_map": [ 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": "1", 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: "pgs": [] 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_osd": [ 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2147483647, 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.130 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 1, 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 0, 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": [ 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": {} 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "servicemap": { 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 3, 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-13T20:16:55.184080+0000", 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "services": { 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "osd": { 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "daemons": { 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "summary": "", 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "0": { 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "start_epoch": 0, 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "start_stamp": "0.000000", 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "gid": 0, 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "metadata": {}, 2026-02-13T20:17:08.131 INFO:tasks.workunit.client.0.trial030.stdout: "task_status": {} 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: "2": { 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: "start_epoch": 0, 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: "start_stamp": "0.000000", 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: "gid": 0, 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: "metadata": {}, 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: "task_status": {} 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_first_committed": 1, 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_last_committed": 41, 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: "logm_first_committed": 1, 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: "logm_last_committed": 237, 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: "paxos": { 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 330, 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: "last_pn": 0, 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: "accepted_pn": 0 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:08.132 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-13T20:17:08.133 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-13T20:17:08.133 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2026-02-13T20:17:08.133 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.0 2026-02-13T20:17:08.133 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:17:08.133 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:17:08.133 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:17:08.133 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:17:08.133 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:17:08.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:17:08.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 0 --op log --pgid 1.0 2026-02-13T20:17:08.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-13T20:17:08.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T20:17:08.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-13T20:17:08.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T20:17:08.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/0 2026-02-13T20:17:08.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/0 --op log --pgid 1.0 2026-02-13T20:17:08.337 INFO:tasks.workunit.client.0.trial030.stderr:PG '1.0' not found 2026-02-13T20:17:08.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-13T20:17:08.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 0 2026-02-13T20:17:08.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T20:17:08.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T20:17:08.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-13T20:17:08.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T20:17:08.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-13T20:17:08.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:17:08.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:17:08.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:17:08.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:17:08.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-13T20:17:08.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-13T20:17:08.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T20:17:08.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T20:17:08.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:17:08.471 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T20:17:08.471 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:17:08.471 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:17:08.471 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:17:08.471 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:17:08.471 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:17:08.472 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:17:08.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:17:08.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:17:08.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:17:08.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:17:08.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:17:08.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:17:08.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:17:08.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:17:08.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T20:17:08.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T20:17:08.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-13T20:17:08.472 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-13T20:17:08.473 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-13T20:17:08.473 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:17:08.473 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-13T20:17:08.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-13T20:17:08.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T20:17:08.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T20:17:08.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T20:17:08.495 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:17:08.489+0000 7f4aa18afa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:17:08.497 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:17:08.489+0000 7f4aa18afa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:17:08.498 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:17:08.493+0000 7f4aa18afa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:17:08.685 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-13T20:17:08.685 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:17:08.685 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T20:17:08.685 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:17:08.685 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:17:08.685 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:17:08.685 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:17:08.685 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:17:08.686 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:17:08.686 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:17:08.878 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:17:08.873+0000 7f4aa18afa40 -1 Falling back to public interface 2026-02-13T20:17:08.912 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 35 up_thru 41 down_at 29 last_clean_interval [5,27) [v2:127.0.0.1:6800/1554368689,v1:127.0.0.1:6801/1554368689] [v2:127.0.0.1:6802/1554368689,v1:127.0.0.1:6803/1554368689] exists,up f07a9a5d-5587-496d-ae5a-150352e2c1fc 2026-02-13T20:17:08.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:17:08.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:17:08.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:17:08.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2026-02-13T20:17:08.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.2 2026-02-13T20:17:08.913 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:17:08.913 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:17:08.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:17:08.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:17:08.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:17:09.021 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:17:09.021 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 2 --op log --pgid 1.0 2026-02-13T20:17:09.021 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-13T20:17:09.021 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T20:17:09.021 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-13T20:17:09.021 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T20:17:09.021 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/2 2026-02-13T20:17:09.021 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/2 --op log --pgid 1.0 2026-02-13T20:17:09.265 INFO:tasks.workunit.client.0.trial030.stderr:PG '1.0' not found 2026-02-13T20:17:09.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-13T20:17:09.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 2 2026-02-13T20:17:09.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T20:17:09.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T20:17:09.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T20:17:09.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T20:17:09.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-13T20:17:09.378 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:17:09.378 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:17:09.378 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:17:09.378 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:17:09.378 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-13T20:17:09.378 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-13T20:17:09.378 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T20:17:09.378 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T20:17:09.378 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:17:09.378 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T20:17:09.378 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:17:09.378 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:17:09.378 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:17:09.378 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:17:09.378 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:17:09.378 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:17:09.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:17:09.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:17:09.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:17:09.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:17:09.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:17:09.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:17:09.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:17:09.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:17:09.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T20:17:09.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T20:17:09.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-13T20:17:09.380 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T20:17:09.380 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-13T20:17:09.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:17:09.381 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-13T20:17:09.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T20:17:09.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T20:17:09.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T20:17:09.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T20:17:09.402 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:17:09.397+0000 7fdcb86d4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:17:09.404 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:17:09.397+0000 7fdcb86d4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:17:09.405 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:17:09.401+0000 7fdcb86d4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:17:09.603 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T20:17:09.603 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:17:09.603 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T20:17:09.603 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:17:09.603 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:17:09.603 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:17:09.604 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:17:09.604 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:17:09.604 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:17:09.604 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:17:09.723 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:17:09.717+0000 7f4aa18afa40 -1 osd.0 42 log_to_monitors true 2026-02-13T20:17:09.819 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 38 up_thru 0 down_at 31 last_clean_interval [14,27) [v2:127.0.0.1:6810/4222706056,v1:127.0.0.1:6811/4222706056] [v2:127.0.0.1:6812/4222706056,v1:127.0.0.1:6813/4222706056] exists,up 3a006542-89c5-41a2-bd52-742aba707d2e 2026-02-13T20:17:09.820 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:17:09.820 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:17:09.820 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:17:09.820 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:336: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 1 --op log --pgid 1.0 2026-02-13T20:17:09.820 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-13T20:17:09.820 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T20:17:09.820 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-13T20:17:09.820 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T20:17:09.820 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-13T20:17:09.820 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op log --pgid 1.0 2026-02-13T20:17:09.822 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:17:09.817+0000 7fdcb86d4a40 -1 Falling back to public interface 2026-02-13T20:17:10.015 INFO:tasks.workunit.client.0.trial030.stderr:PG '1.0' not found 2026-02-13T20:17:10.122 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-13T20:17:10.122 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-13T20:17:10.122 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: wait_for_clean 2026-02-13T20:17:10.122 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T20:17:10.122 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T20:17:10.122 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T20:17:10.122 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-13T20:17:10.123 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T20:17:10.123 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T20:17:10.123 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T20:17:10.123 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T20:17:10.123 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T20:17:10.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-13T20:17:10.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T20:17:10.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T20:17:10.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T20:17:10.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T20:17:10.195 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T20:17:10.417 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T20:17:10.417 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:17:10.417 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-13T20:17:10.417 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T20:17:10.417 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:17:10.418 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-13T20:17:10.503 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528323 2026-02-13T20:17:10.503 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528323 2026-02-13T20:17:10.503 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-193273528323' 2026-02-13T20:17:10.503 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:17:10.503 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-13T20:17:10.541 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:17:10.537+0000 7fdcb86d4a40 -1 osd.2 42 log_to_monitors true 2026-02-13T20:17:10.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-13T20:17:10.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-13T20:17:10.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-13T20:17:10.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-13T20:17:10.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:17:10.566 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-13T20:17:15.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=210453397508 2026-02-13T20:17:15.653 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 210453397508 2026-02-13T20:17:15.653 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-193273528323 2-210453397508' 2026-02-13T20:17:15.653 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:17:15.654 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-193273528323 2026-02-13T20:17:15.654 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:17:15.654 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-13T20:17:15.655 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-193273528323 2026-02-13T20:17:15.655 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:17:15.656 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=193273528323 2026-02-13T20:17:15.656 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 193273528323 2026-02-13T20:17:15.657 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 193273528323' 2026-02-13T20:17:15.657 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:17:15.883 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 193273528324 -lt 193273528323 2026-02-13T20:17:15.883 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:17:15.884 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-210453397508 2026-02-13T20:17:15.884 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:17:15.885 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-13T20:17:15.886 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-210453397508 2026-02-13T20:17:15.886 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:17:15.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=210453397508 2026-02-13T20:17:15.888 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 210453397508 2026-02-13T20:17:15.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 210453397508' 2026-02-13T20:17:15.889 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:17:16.117 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 210453397508 2026-02-13T20:17:16.118 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:17:17.119 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T20:17:17.120 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:17:17.338 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 210453397508 -lt 210453397508 2026-02-13T20:17:17.339 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T20:17:17.339 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:17:17.339 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:17:17.636 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T20:17:17.636 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:17:17.637 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:17:17.637 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:17:17.637 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:17:17.637 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:17:17.637 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:17:17.637 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:17:17.859 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:17:17.859 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:17:17.860 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:17:17.860 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:17:18.153 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:17:18.153 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-13T20:17:18.153 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-13T20:17:18.153 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-13T20:17:18.153 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:17:18.153 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-13T20:17:18.253 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:17:18.253 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:17:18.253 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:17:18.253 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:17:18.254 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:17:18.254 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:17:18.254 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:17:18.254 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:17:18.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:17:18.473 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:17:18.473 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:17:18.473 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:17:18.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:17:18.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:17:18.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:17:18.764 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:17:18.764 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:17:18.764 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:17:18.764 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:17:18.764 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:17:18.764 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:17:19.055 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:17:19.055 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:17:19.055 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-13T20:17:19.055 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:17:19.055 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-13T20:17:19.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:17:19.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:17:19.256 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:17:19.256 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:17:19.257 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:17:19.257 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:17:19.257 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:17:19.257 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:17:19.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:17:19.471 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:17:19.472 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:17:19.472 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:17:19.764 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:17:19.765 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:17:19.765 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:17:19.765 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:17:19.765 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:17:19.765 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:17:19.765 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:17:19.765 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:17:19.765 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:17:20.054 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:17:20.054 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:17:20.054 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-13T20:17:20.054 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:17:20.054 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-13T20:17:20.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:17:20.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:17:20.457 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:17:20.457 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:17:20.457 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:17:20.457 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:17:20.458 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:17:20.458 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:17:20.683 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:17:20.684 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:17:20.684 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:17:20.684 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:17:20.979 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:17:20.979 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:17:20.979 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:17:20.979 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:17:20.979 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:17:20.979 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:17:20.979 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:17:20.979 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:17:20.979 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:17:21.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:17:21.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:17:21.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-13T20:17:21.274 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:17:21.274 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-13T20:17:22.074 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:17:22.074 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:17:22.074 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:17:22.074 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:17:22.074 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:17:22.074 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:17:22.075 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:17:22.075 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:17:22.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:17:22.293 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:17:22.293 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:17:22.294 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:17:22.575 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:17:22.575 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:17:22.575 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:17:22.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:17:22.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:17:22.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:17:22.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:17:22.576 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:17:22.576 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:17:22.859 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:17:22.859 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:17:22.859 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-13T20:17:22.859 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:17:22.859 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-13T20:17:24.459 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:17:24.459 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:17:24.460 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:17:24.460 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:17:24.460 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:17:24.460 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:17:24.460 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:17:24.460 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:17:24.677 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:17:24.678 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:17:24.678 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:17:24.678 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:17:24.967 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:17:24.967 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:17:24.967 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:17:24.967 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:17:24.967 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:17:24.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:17:24.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:17:24.968 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:17:24.968 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:17:25.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:17:25.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:17:25.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-13T20:17:25.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:17:25.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-13T20:17:28.457 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:17:28.457 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:17:28.458 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:17:28.458 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:17:28.458 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:17:28.458 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:17:28.458 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:17:28.458 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:17:28.675 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:17:28.675 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:17:28.676 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:17:28.676 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:17:28.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:17:28.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:17:28.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:17:28.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:17:28.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:17:28.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:17:28.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:17:28.970 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:17:28.970 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:17:29.254 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:17:29.254 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:17:29.254 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-13T20:17:29.254 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:17:29.254 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-13T20:17:35.655 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:17:35.656 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:17:35.656 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:17:35.656 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:17:35.656 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:17:35.656 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:17:35.657 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:17:35.657 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:17:35.875 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:17:35.876 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:17:35.876 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:17:35.876 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:17:36.161 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:17:36.161 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:17:36.161 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:17:36.161 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:17:36.162 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:17:36.162 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:17:36.162 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:17:36.162 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:17:36.162 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:17:36.449 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:17:36.449 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:17:36.449 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-13T20:17:36.449 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T20:17:36.449 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-13T20:17:43.750 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T20:17:43.750 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:17:43.751 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:17:43.751 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:17:43.751 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:17:43.751 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:17:43.751 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:17:43.751 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:17:43.971 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T20:17:43.972 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:17:43.972 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:17:43.972 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:17:44.253 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T20:17:44.253 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T20:17:44.253 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T20:17:44.253 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T20:17:44.253 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T20:17:44.253 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T20:17:44.253 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T20:17:44.254 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T20:17:44.254 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T20:17:44.539 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T20:17:44.539 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T20:17:44.539 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-13T20:17:44.539 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-13T20:17:44.825 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-13T20:17:44.825 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_fingerprint": "7608e7ee-f1af-44f1-a372-f78a91726508", 2026-02-13T20:17:44.825 INFO:tasks.workunit.client.0.trial030.stdout: "version": "20.3.0-5230-gafefaa40", 2026-02-13T20:17:44.825 INFO:tasks.workunit.client.0.trial030.stdout: "commit": "afefaa40503a4bf024e96f97dd7f852b75f00ad6", 2026-02-13T20:17:44.825 INFO:tasks.workunit.client.0.trial030.stdout: "timestamp": "2026-02-13T20:17:44.823564+0000", 2026-02-13T20:17:44.825 INFO:tasks.workunit.client.0.trial030.stdout: "tag": "", 2026-02-13T20:17:44.826 INFO:tasks.workunit.client.0.trial030.stdout: "health": { 2026-02-13T20:17:44.826 INFO:tasks.workunit.client.0.trial030.stdout: "status": "HEALTH_WARN", 2026-02-13T20:17:44.826 INFO:tasks.workunit.client.0.trial030.stdout: "checks": { 2026-02-13T20:17:44.826 INFO:tasks.workunit.client.0.trial030.stdout: "OSDMAP_FLAGS": { 2026-02-13T20:17:44.826 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-13T20:17:44.826 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-13T20:17:44.826 INFO:tasks.workunit.client.0.trial030.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-13T20:17:44.826 INFO:tasks.workunit.client.0.trial030.stdout: "count": 17 2026-02-13T20:17:44.826 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.826 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [], 2026-02-13T20:17:44.826 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-13T20:17:44.827 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.827 INFO:tasks.workunit.client.0.trial030.stdout: "OSD_DOWN": { 2026-02-13T20:17:44.827 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-13T20:17:44.827 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-13T20:17:44.827 INFO:tasks.workunit.client.0.trial030.stdout: "message": "1 osds down", 2026-02-13T20:17:44.827 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-13T20:17:44.827 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.827 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-13T20:17:44.827 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.827 INFO:tasks.workunit.client.0.trial030.stdout: "message": "osd.1 (root=default,host=trial030) is down" 2026-02-13T20:17:44.827 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.827 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:44.828 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-13T20:17:44.828 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.828 INFO:tasks.workunit.client.0.trial030.stdout: "PG_DEGRADED": { 2026-02-13T20:17:44.828 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-13T20:17:44.828 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-13T20:17:44.828 INFO:tasks.workunit.client.0.trial030.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2026-02-13T20:17:44.828 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-13T20:17:44.828 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.828 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-13T20:17:44.828 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.828 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [NONE,0,2]" 2026-02-13T20:17:44.828 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.829 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:44.829 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-13T20:17:44.829 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.829 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.829 INFO:tasks.workunit.client.0.trial030.stdout: "mutes": [] 2026-02-13T20:17:44.829 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.829 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_first_committed": 1, 2026-02-13T20:17:44.829 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_last_committed": 1, 2026-02-13T20:17:44.829 INFO:tasks.workunit.client.0.trial030.stdout: "monmap": { 2026-02-13T20:17:44.829 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-13T20:17:44.829 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "76a1de22-3326-43d1-82f4-48cedec81b31", 2026-02-13T20:17:44.829 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-13T20:15:46.671477Z", 2026-02-13T20:17:44.830 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-13T20:15:46.671477Z", 2026-02-13T20:17:44.830 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release": 20, 2026-02-13T20:17:44.830 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:17:44.830 INFO:tasks.workunit.client.0.trial030.stdout: "election_strategy": 1, 2026-02-13T20:17:44.830 INFO:tasks.workunit.client.0.trial030.stdout: "disallowed_leaders": "", 2026-02-13T20:17:44.830 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": false, 2026-02-13T20:17:44.830 INFO:tasks.workunit.client.0.trial030.stdout: "tiebreaker_mon": "", 2026-02-13T20:17:44.830 INFO:tasks.workunit.client.0.trial030.stdout: "removed_ranks": "", 2026-02-13T20:17:44.830 INFO:tasks.workunit.client.0.trial030.stdout: "features": { 2026-02-13T20:17:44.830 INFO:tasks.workunit.client.0.trial030.stdout: "persistent": [ 2026-02-13T20:17:44.830 INFO:tasks.workunit.client.0.trial030.stdout: "kraken", 2026-02-13T20:17:44.830 INFO:tasks.workunit.client.0.trial030.stdout: "luminous", 2026-02-13T20:17:44.830 INFO:tasks.workunit.client.0.trial030.stdout: "mimic", 2026-02-13T20:17:44.831 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap-prune", 2026-02-13T20:17:44.831 INFO:tasks.workunit.client.0.trial030.stdout: "nautilus", 2026-02-13T20:17:44.831 INFO:tasks.workunit.client.0.trial030.stdout: "octopus", 2026-02-13T20:17:44.831 INFO:tasks.workunit.client.0.trial030.stdout: "pacific", 2026-02-13T20:17:44.831 INFO:tasks.workunit.client.0.trial030.stdout: "elector-pinging", 2026-02-13T20:17:44.831 INFO:tasks.workunit.client.0.trial030.stdout: "quincy", 2026-02-13T20:17:44.831 INFO:tasks.workunit.client.0.trial030.stdout: "reef", 2026-02-13T20:17:44.831 INFO:tasks.workunit.client.0.trial030.stdout: "squid", 2026-02-13T20:17:44.831 INFO:tasks.workunit.client.0.trial030.stdout: "tentacle", 2026-02-13T20:17:44.831 INFO:tasks.workunit.client.0.trial030.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:44.831 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:44.831 INFO:tasks.workunit.client.0.trial030.stdout: "optional": [] 2026-02-13T20:17:44.832 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.832 INFO:tasks.workunit.client.0.trial030.stdout: "mons": [ 2026-02-13T20:17:44.832 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.832 INFO:tasks.workunit.client.0.trial030.stdout: "rank": 0, 2026-02-13T20:17:44.832 INFO:tasks.workunit.client.0.trial030.stdout: "name": "a", 2026-02-13T20:17:44.832 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:17:44.832 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:44.832 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.832 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:44.832 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115", 2026-02-13T20:17:44.832 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 0 2026-02-13T20:17:44.832 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.832 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.833 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.833 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115/0", 2026-02-13T20:17:44.833 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-13T20:17:44.833 INFO:tasks.workunit.client.0.trial030.stdout: "priority": 0, 2026-02-13T20:17:44.833 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 0, 2026-02-13T20:17:44.833 INFO:tasks.workunit.client.0.trial030.stdout: "time_added": "2026-02-13T20:15:46:671475+0000", 2026-02-13T20:17:44.833 INFO:tasks.workunit.client.0.trial030.stdout: "crush_location": [] 2026-02-13T20:17:44.833 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.833 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.833 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.833 INFO:tasks.workunit.client.0.trial030.stdout: "quorum": [ 2026-02-13T20:17:44.833 INFO:tasks.workunit.client.0.trial030.stdout: 0 2026-02-13T20:17:44.833 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:44.834 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap": { 2026-02-13T20:17:44.834 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 50, 2026-02-13T20:17:44.834 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "76a1de22-3326-43d1-82f4-48cedec81b31", 2026-02-13T20:17:44.834 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-13T20:15:46.746126+0000", 2026-02-13T20:17:44.834 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-13T20:17:10.910586+0000", 2026-02-13T20:17:44.834 INFO:tasks.workunit.client.0.trial030.stdout: "last_up_change": "2026-02-13T20:17:10.807997+0000", 2026-02-13T20:17:44.834 INFO:tasks.workunit.client.0.trial030.stdout: "last_in_change": "2026-02-13T20:16:33.160113+0000", 2026-02-13T20:17:44.834 INFO:tasks.workunit.client.0.trial030.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-13T20:17:44.834 INFO:tasks.workunit.client.0.trial030.stdout: "flags_num": 5800384, 2026-02-13T20:17:44.834 INFO:tasks.workunit.client.0.trial030.stdout: "flags_set": [ 2026-02-13T20:17:44.834 INFO:tasks.workunit.client.0.trial030.stdout: "nodown", 2026-02-13T20:17:44.834 INFO:tasks.workunit.client.0.trial030.stdout: "noin", 2026-02-13T20:17:44.835 INFO:tasks.workunit.client.0.trial030.stdout: "noout", 2026-02-13T20:17:44.835 INFO:tasks.workunit.client.0.trial030.stdout: "pglog_hardlimit", 2026-02-13T20:17:44.835 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snapdirs", 2026-02-13T20:17:44.835 INFO:tasks.workunit.client.0.trial030.stdout: "recovery_deletes", 2026-02-13T20:17:44.835 INFO:tasks.workunit.client.0.trial030.stdout: "sortbitwise" 2026-02-13T20:17:44.835 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:44.835 INFO:tasks.workunit.client.0.trial030.stdout: "crush_version": 12, 2026-02-13T20:17:44.835 INFO:tasks.workunit.client.0.trial030.stdout: "full_ratio": 0.99000000953674316, 2026-02-13T20:17:44.835 INFO:tasks.workunit.client.0.trial030.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-13T20:17:44.835 INFO:tasks.workunit.client.0.trial030.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-13T20:17:44.835 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_snapshot": "", 2026-02-13T20:17:44.835 INFO:tasks.workunit.client.0.trial030.stdout: "pool_max": 1, 2026-02-13T20:17:44.835 INFO:tasks.workunit.client.0.trial030.stdout: "max_osd": 3, 2026-02-13T20:17:44.836 INFO:tasks.workunit.client.0.trial030.stdout: "require_min_compat_client": "luminous", 2026-02-13T20:17:44.836 INFO:tasks.workunit.client.0.trial030.stdout: "min_compat_client": "jewel", 2026-02-13T20:17:44.836 INFO:tasks.workunit.client.0.trial030.stdout: "require_osd_release": "tentacle", 2026-02-13T20:17:44.836 INFO:tasks.workunit.client.0.trial030.stdout: "allow_crimson": false, 2026-02-13T20:17:44.836 INFO:tasks.workunit.client.0.trial030.stdout: "pools": [ 2026-02-13T20:17:44.836 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.836 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-13T20:17:44.836 INFO:tasks.workunit.client.0.trial030.stdout: "pool_name": "test", 2026-02-13T20:17:44.836 INFO:tasks.workunit.client.0.trial030.stdout: "create_time": "2026-02-13T20:15:58.996476+0000", 2026-02-13T20:17:44.836 INFO:tasks.workunit.client.0.trial030.stdout: "flags": 16389, 2026-02-13T20:17:44.836 INFO:tasks.workunit.client.0.trial030.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2026-02-13T20:17:44.836 INFO:tasks.workunit.client.0.trial030.stdout: "type": 3, 2026-02-13T20:17:44.837 INFO:tasks.workunit.client.0.trial030.stdout: "size": 3, 2026-02-13T20:17:44.837 INFO:tasks.workunit.client.0.trial030.stdout: "min_size": 2, 2026-02-13T20:17:44.837 INFO:tasks.workunit.client.0.trial030.stdout: "crush_rule": 1, 2026-02-13T20:17:44.837 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_count": 0, 2026-02-13T20:17:44.837 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_target": 0, 2026-02-13T20:17:44.837 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_barrier": 0, 2026-02-13T20:17:44.837 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-13T20:17:44.837 INFO:tasks.workunit.client.0.trial030.stdout: "is_stretch_pool": false, 2026-02-13T20:17:44.837 INFO:tasks.workunit.client.0.trial030.stdout: "object_hash": 2, 2026-02-13T20:17:44.837 INFO:tasks.workunit.client.0.trial030.stdout: "pg_autoscale_mode": "off", 2026-02-13T20:17:44.837 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num": 1, 2026-02-13T20:17:44.837 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num": 1, 2026-02-13T20:17:44.837 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num_target": 1, 2026-02-13T20:17:44.837 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_target": 1, 2026-02-13T20:17:44.838 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_pending": 1, 2026-02-13T20:17:44.838 INFO:tasks.workunit.client.0.trial030.stdout: "last_pg_merge_meta": { 2026-02-13T20:17:44.838 INFO:tasks.workunit.client.0.trial030.stdout: "source_pgid": "0.0", 2026-02-13T20:17:44.838 INFO:tasks.workunit.client.0.trial030.stdout: "ready_epoch": 0, 2026-02-13T20:17:44.838 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_started": 0, 2026-02-13T20:17:44.838 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": 0, 2026-02-13T20:17:44.838 INFO:tasks.workunit.client.0.trial030.stdout: "source_version": "0'0", 2026-02-13T20:17:44.838 INFO:tasks.workunit.client.0.trial030.stdout: "target_version": "0'0" 2026-02-13T20:17:44.838 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.838 INFO:tasks.workunit.client.0.trial030.stdout: "last_change": "28", 2026-02-13T20:17:44.838 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend": "0", 2026-02-13T20:17:44.838 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-13T20:17:44.839 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_preluminous": "0", 2026-02-13T20:17:44.839 INFO:tasks.workunit.client.0.trial030.stdout: "auid": 0, 2026-02-13T20:17:44.839 INFO:tasks.workunit.client.0.trial030.stdout: "snap_mode": "pool", 2026-02-13T20:17:44.839 INFO:tasks.workunit.client.0.trial030.stdout: "snap_seq": 1, 2026-02-13T20:17:44.839 INFO:tasks.workunit.client.0.trial030.stdout: "snap_epoch": 28, 2026-02-13T20:17:44.839 INFO:tasks.workunit.client.0.trial030.stdout: "pool_snaps": [ 2026-02-13T20:17:44.839 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.839 INFO:tasks.workunit.client.0.trial030.stdout: "snapid": 1, 2026-02-13T20:17:44.839 INFO:tasks.workunit.client.0.trial030.stdout: "stamp": "2026-02-13T20:16:17.250846+0000", 2026-02-13T20:17:44.839 INFO:tasks.workunit.client.0.trial030.stdout: "name": "snap1" 2026-02-13T20:17:44.839 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.839 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:44.839 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps": "[]", 2026-02-13T20:17:44.839 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_bytes": 0, 2026-02-13T20:17:44.840 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_objects": 0, 2026-02-13T20:17:44.840 INFO:tasks.workunit.client.0.trial030.stdout: "tiers": [], 2026-02-13T20:17:44.840 INFO:tasks.workunit.client.0.trial030.stdout: "tier_of": -1, 2026-02-13T20:17:44.840 INFO:tasks.workunit.client.0.trial030.stdout: "read_tier": -1, 2026-02-13T20:17:44.840 INFO:tasks.workunit.client.0.trial030.stdout: "write_tier": -1, 2026-02-13T20:17:44.840 INFO:tasks.workunit.client.0.trial030.stdout: "cache_mode": "none", 2026-02-13T20:17:44.840 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_bytes": 0, 2026-02-13T20:17:44.840 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_objects": 0, 2026-02-13T20:17:44.840 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-13T20:17:44.840 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-13T20:17:44.840 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-13T20:17:44.840 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_flush_age": 0, 2026-02-13T20:17:44.840 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_evict_age": 0, 2026-02-13T20:17:44.841 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profile": "myprofile", 2026-02-13T20:17:44.841 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_params": { 2026-02-13T20:17:44.841 INFO:tasks.workunit.client.0.trial030.stdout: "type": "none" 2026-02-13T20:17:44.841 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.841 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_period": 0, 2026-02-13T20:17:44.841 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_count": 0, 2026-02-13T20:17:44.841 INFO:tasks.workunit.client.0.trial030.stdout: "use_gmt_hitset": true, 2026-02-13T20:17:44.841 INFO:tasks.workunit.client.0.trial030.stdout: "min_read_recency_for_promote": 0, 2026-02-13T20:17:44.841 INFO:tasks.workunit.client.0.trial030.stdout: "min_write_recency_for_promote": 0, 2026-02-13T20:17:44.841 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_grade_decay_rate": 0, 2026-02-13T20:17:44.841 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_search_last_n": 0, 2026-02-13T20:17:44.841 INFO:tasks.workunit.client.0.trial030.stdout: "grade_table": [], 2026-02-13T20:17:44.841 INFO:tasks.workunit.client.0.trial030.stdout: "stripe_width": 8192, 2026-02-13T20:17:44.842 INFO:tasks.workunit.client.0.trial030.stdout: "expected_num_objects": 0, 2026-02-13T20:17:44.842 INFO:tasks.workunit.client.0.trial030.stdout: "fast_read": false, 2026-02-13T20:17:44.842 INFO:tasks.workunit.client.0.trial030.stdout: "nonprimary_shards": "{}", 2026-02-13T20:17:44.842 INFO:tasks.workunit.client.0.trial030.stdout: "options": {}, 2026-02-13T20:17:44.842 INFO:tasks.workunit.client.0.trial030.stdout: "application_metadata": {} 2026-02-13T20:17:44.842 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.842 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:44.842 INFO:tasks.workunit.client.0.trial030.stdout: "osds": [ 2026-02-13T20:17:44.842 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.842 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:17:44.842 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "f07a9a5d-5587-496d-ae5a-150352e2c1fc", 2026-02-13T20:17:44.842 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-13T20:17:44.842 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-13T20:17:44.843 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-13T20:17:44.843 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-13T20:17:44.843 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 35, 2026-02-13T20:17:44.843 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 42, 2026-02-13T20:17:44.843 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 45, 2026-02-13T20:17:44.843 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 49, 2026-02-13T20:17:44.843 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 44, 2026-02-13T20:17:44.843 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-13T20:17:44.843 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:17:44.843 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:44.843 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.843 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:44.843 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6800", 2026-02-13T20:17:44.844 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1411078054 2026-02-13T20:17:44.844 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.844 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.844 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:44.844 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6801", 2026-02-13T20:17:44.844 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1411078054 2026-02-13T20:17:44.844 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.844 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.844 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.844 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-13T20:17:44.844 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:44.844 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.845 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:44.845 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6802", 2026-02-13T20:17:44.845 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1411078054 2026-02-13T20:17:44.845 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.845 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.845 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:44.845 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6803", 2026-02-13T20:17:44.845 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1411078054 2026-02-13T20:17:44.845 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.845 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.845 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.845 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-13T20:17:44.845 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:44.846 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.846 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:44.846 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6806", 2026-02-13T20:17:44.846 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1411078054 2026-02-13T20:17:44.846 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.846 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.846 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:44.846 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6807", 2026-02-13T20:17:44.846 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1411078054 2026-02-13T20:17:44.846 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.846 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.846 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.846 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-13T20:17:44.847 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:44.847 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.847 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:44.847 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6804", 2026-02-13T20:17:44.847 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1411078054 2026-02-13T20:17:44.847 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.847 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.847 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:44.847 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6805", 2026-02-13T20:17:44.847 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1411078054 2026-02-13T20:17:44.847 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.847 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.847 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.848 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6801/1411078054", 2026-02-13T20:17:44.848 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6803/1411078054", 2026-02-13T20:17:44.848 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6807/1411078054", 2026-02-13T20:17:44.848 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6805/1411078054", 2026-02-13T20:17:44.848 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-13T20:17:44.848 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-13T20:17:44.848 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-13T20:17:44.848 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.848 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.848 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.848 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:17:44.848 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "c7c6b311-7783-4c87-a03d-8e96a204ca78", 2026-02-13T20:17:44.849 INFO:tasks.workunit.client.0.trial030.stdout: "up": 0, 2026-02-13T20:17:44.849 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-13T20:17:44.849 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-13T20:17:44.849 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-13T20:17:44.849 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 0, 2026-02-13T20:17:44.849 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 0, 2026-02-13T20:17:44.849 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 9, 2026-02-13T20:17:44.849 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 23, 2026-02-13T20:17:44.849 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 30, 2026-02-13T20:17:44.849 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-13T20:17:44.849 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:17:44.849 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:44.849 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.849 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:44.850 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-13T20:17:44.850 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1652690354 2026-02-13T20:17:44.850 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.850 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.850 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:44.850 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-13T20:17:44.850 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1652690354 2026-02-13T20:17:44.850 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.850 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.850 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.850 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-13T20:17:44.850 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:44.851 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.851 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:44.851 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-13T20:17:44.851 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1652690354 2026-02-13T20:17:44.851 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.851 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.851 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:44.851 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-13T20:17:44.851 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1652690354 2026-02-13T20:17:44.851 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.851 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.851 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.851 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-13T20:17:44.852 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:44.852 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.852 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:44.852 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-13T20:17:44.852 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1652690354 2026-02-13T20:17:44.852 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.852 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.852 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:44.852 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-13T20:17:44.852 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1652690354 2026-02-13T20:17:44.852 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.852 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.852 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.852 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-13T20:17:44.853 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:44.853 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.853 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:44.853 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-13T20:17:44.853 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1652690354 2026-02-13T20:17:44.853 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.853 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.853 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:44.853 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-13T20:17:44.853 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1652690354 2026-02-13T20:17:44.853 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.853 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.853 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.854 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/1652690354", 2026-02-13T20:17:44.854 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/1652690354", 2026-02-13T20:17:44.854 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1652690354", 2026-02-13T20:17:44.854 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1652690354", 2026-02-13T20:17:44.854 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-13T20:17:44.854 INFO:tasks.workunit.client.0.trial030.stdout: "exists" 2026-02-13T20:17:44.854 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.854 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.854 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.854 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:17:44.854 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "3a006542-89c5-41a2-bd52-742aba707d2e", 2026-02-13T20:17:44.854 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-13T20:17:44.854 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-13T20:17:44.855 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-13T20:17:44.855 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-13T20:17:44.855 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 38, 2026-02-13T20:17:44.855 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 42, 2026-02-13T20:17:44.855 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 49, 2026-02-13T20:17:44.855 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 0, 2026-02-13T20:17:44.855 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 48, 2026-02-13T20:17:44.855 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-13T20:17:44.855 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-13T20:17:44.855 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:44.855 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.855 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:44.855 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-13T20:17:44.856 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1901658060 2026-02-13T20:17:44.856 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.856 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.856 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:44.856 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-13T20:17:44.856 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1901658060 2026-02-13T20:17:44.856 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.856 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.856 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.856 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-13T20:17:44.856 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:44.856 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.856 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:44.857 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-13T20:17:44.857 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1901658060 2026-02-13T20:17:44.857 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.857 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.857 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:44.857 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-13T20:17:44.857 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1901658060 2026-02-13T20:17:44.857 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.857 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.857 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.857 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-13T20:17:44.857 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:44.857 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.857 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:44.858 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-13T20:17:44.858 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1901658060 2026-02-13T20:17:44.858 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.858 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.858 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:44.858 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-13T20:17:44.858 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1901658060 2026-02-13T20:17:44.858 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.858 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.858 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.858 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-13T20:17:44.858 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-13T20:17:44.858 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.858 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-13T20:17:44.859 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-13T20:17:44.859 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1901658060 2026-02-13T20:17:44.859 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.859 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.859 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-13T20:17:44.859 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-13T20:17:44.859 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1901658060 2026-02-13T20:17:44.859 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.859 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.859 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.859 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/1901658060", 2026-02-13T20:17:44.859 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/1901658060", 2026-02-13T20:17:44.859 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1901658060", 2026-02-13T20:17:44.860 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1901658060", 2026-02-13T20:17:44.860 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-13T20:17:44.860 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-13T20:17:44.860 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-13T20:17:44.860 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.860 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.860 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:44.860 INFO:tasks.workunit.client.0.trial030.stdout: "osd_xinfo": [ 2026-02-13T20:17:44.860 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.860 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:17:44.860 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-13T20:17:09.893190+0000", 2026-02-13T20:17:44.860 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-13T20:17:44.860 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-13T20:17:44.861 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-13T20:17:44.861 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-13T20:17:44.861 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-13T20:15:50.522788+0000", 2026-02-13T20:17:44.861 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-13T20:17:44.861 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.861 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.861 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:17:44.861 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-13T20:16:28.209541+0000", 2026-02-13T20:17:44.861 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-13T20:17:44.862 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-13T20:17:44.862 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-13T20:17:44.862 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-13T20:17:44.862 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-13T20:15:53.937861+0000", 2026-02-13T20:17:44.862 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-13T20:17:44.862 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.862 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.862 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:17:44.862 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-13T20:17:10.707396+0000", 2026-02-13T20:17:44.862 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-13T20:17:44.862 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-13T20:17:44.862 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-13T20:17:44.862 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-13T20:17:44.862 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-13T20:15:57.994611+0000", 2026-02-13T20:17:44.863 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-13T20:17:44.863 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.863 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:44.863 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap": [], 2026-02-13T20:17:44.863 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_items": [], 2026-02-13T20:17:44.863 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_primaries": [], 2026-02-13T20:17:44.863 INFO:tasks.workunit.client.0.trial030.stdout: "pg_temp": [], 2026-02-13T20:17:44.863 INFO:tasks.workunit.client.0.trial030.stdout: "primary_temp": [], 2026-02-13T20:17:44.863 INFO:tasks.workunit.client.0.trial030.stdout: "blocklist": {}, 2026-02-13T20:17:44.863 INFO:tasks.workunit.client.0.trial030.stdout: "range_blocklist": {}, 2026-02-13T20:17:44.863 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profiles": { 2026-02-13T20:17:44.863 INFO:tasks.workunit.client.0.trial030.stdout: "default": { 2026-02-13T20:17:44.863 INFO:tasks.workunit.client.0.trial030.stdout: "k": "2", 2026-02-13T20:17:44.863 INFO:tasks.workunit.client.0.trial030.stdout: "m": "2", 2026-02-13T20:17:44.864 INFO:tasks.workunit.client.0.trial030.stdout: "plugin": "isa", 2026-02-13T20:17:44.864 INFO:tasks.workunit.client.0.trial030.stdout: "technique": "reed_sol_van" 2026-02-13T20:17:44.864 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.864 INFO:tasks.workunit.client.0.trial030.stdout: "myprofile": { 2026-02-13T20:17:44.864 INFO:tasks.workunit.client.0.trial030.stdout: "crush-device-class": "", 2026-02-13T20:17:44.864 INFO:tasks.workunit.client.0.trial030.stdout: "crush-failure-domain": "osd", 2026-02-13T20:17:44.864 INFO:tasks.workunit.client.0.trial030.stdout: "crush-num-failure-domains": "0", 2026-02-13T20:17:44.864 INFO:tasks.workunit.client.0.trial030.stdout: "crush-osds-per-failure-domain": "0", 2026-02-13T20:17:44.864 INFO:tasks.workunit.client.0.trial030.stdout: "crush-root": "default", 2026-02-13T20:17:44.864 INFO:tasks.workunit.client.0.trial030.stdout: "k": "2", 2026-02-13T20:17:44.864 INFO:tasks.workunit.client.0.trial030.stdout: "m": "1", 2026-02-13T20:17:44.864 INFO:tasks.workunit.client.0.trial030.stdout: "plugin": "isa", 2026-02-13T20:17:44.864 INFO:tasks.workunit.client.0.trial030.stdout: "technique": "reed_sol_van" 2026-02-13T20:17:44.864 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.864 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.864 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps_queue": [], 2026-02-13T20:17:44.864 INFO:tasks.workunit.client.0.trial030.stdout: "new_removed_snaps": [], 2026-02-13T20:17:44.865 INFO:tasks.workunit.client.0.trial030.stdout: "new_purged_snaps": [], 2026-02-13T20:17:44.865 INFO:tasks.workunit.client.0.trial030.stdout: "crush_node_flags": {}, 2026-02-13T20:17:44.865 INFO:tasks.workunit.client.0.trial030.stdout: "device_class_flags": {}, 2026-02-13T20:17:44.865 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": { 2026-02-13T20:17:44.865 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_enabled": false, 2026-02-13T20:17:44.865 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_bucket_count": 0, 2026-02-13T20:17:44.865 INFO:tasks.workunit.client.0.trial030.stdout: "degraded_stretch_mode": 0, 2026-02-13T20:17:44.865 INFO:tasks.workunit.client.0.trial030.stdout: "recovering_stretch_mode": 0, 2026-02-13T20:17:44.865 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_bucket": 0 2026-02-13T20:17:44.865 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.865 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.865 INFO:tasks.workunit.client.0.trial030.stdout: "osd_metadata": [ 2026-02-13T20:17:44.865 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.865 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:17:44.865 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-13T20:17:44.865 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6802/1411078054,v1:127.0.0.1:6803/1411078054]", 2026-02-13T20:17:44.866 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-13T20:17:44.866 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-13T20:17:44.866 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-13T20:17:44.866 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T20:17:44.866 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-13T20:17:44.866 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T20:17:44.866 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-13T20:17:44.866 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T20:17:44.866 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T20:17:44.866 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T20:17:44.866 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T20:17:44.866 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T20:17:44.866 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-13T20:17:44.866 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T20:17:44.866 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T20:17:44.866 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T20:17:44.867 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T20:17:44.867 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T20:17:44.867 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T20:17:44.867 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-13T20:17:44.867 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-13T20:17:44.867 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:17:44.867 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-13T20:17:44.867 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:17:44.867 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T20:17:44.867 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-13T20:15:47.740468Z", 2026-02-13T20:17:44.867 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-13T20:17:44.867 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-13T20:17:44.867 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T20:17:44.867 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-13T20:17:44.867 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-13T20:17:44.867 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T20:17:44.867 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-13T20:17:44.868 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6800/1411078054,v1:127.0.0.1:6801/1411078054]", 2026-02-13T20:17:44.868 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-13T20:17:44.868 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/1411078054,v1:127.0.0.1:6807/1411078054]", 2026-02-13T20:17:44.868 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/1411078054,v1:127.0.0.1:6805/1411078054]", 2026-02-13T20:17:44.868 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-13T20:17:44.868 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-13T20:17:44.868 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T20:17:44.868 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T20:17:44.868 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-13T20:17:44.868 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961704", 2026-02-13T20:17:44.868 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T20:17:44.868 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-13T20:17:44.868 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-13T20:17:44.868 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-13T20:17:44.868 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/0", 2026-02-13T20:17:44.868 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-13T20:17:44.868 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-13T20:17:44.869 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-13T20:17:44.869 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.869 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.869 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:17:44.869 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-13T20:17:44.869 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/1652690354,v1:127.0.0.1:6813/1652690354]", 2026-02-13T20:17:44.869 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-13T20:17:44.869 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-13T20:17:44.869 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-13T20:17:44.869 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T20:17:44.869 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-13T20:17:44.869 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T20:17:44.869 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-13T20:17:44.869 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T20:17:44.869 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T20:17:44.869 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T20:17:44.869 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T20:17:44.870 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T20:17:44.870 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-13T20:17:44.870 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T20:17:44.870 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T20:17:44.870 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T20:17:44.870 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T20:17:44.870 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T20:17:44.870 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T20:17:44.870 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-13T20:17:44.870 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-13T20:17:44.870 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:17:44.870 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-13T20:17:44.870 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:17:44.870 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T20:17:44.870 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-13T20:15:51.455689Z", 2026-02-13T20:17:44.870 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-13T20:17:44.870 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-13T20:17:44.870 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T20:17:44.871 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-13T20:17:44.871 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-13T20:17:44.871 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T20:17:44.871 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-13T20:17:44.871 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/1652690354,v1:127.0.0.1:6811/1652690354]", 2026-02-13T20:17:44.871 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-13T20:17:44.871 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1652690354,v1:127.0.0.1:6817/1652690354]", 2026-02-13T20:17:44.871 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1652690354,v1:127.0.0.1:6815/1652690354]", 2026-02-13T20:17:44.871 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-13T20:17:44.871 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-13T20:17:44.871 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T20:17:44.871 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T20:17:44.871 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-13T20:17:44.871 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961704", 2026-02-13T20:17:44.871 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T20:17:44.871 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-13T20:17:44.871 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-13T20:17:44.871 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-13T20:17:44.871 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/1", 2026-02-13T20:17:44.871 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-13T20:17:44.872 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-13T20:17:44.872 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-13T20:17:44.872 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.872 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.872 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:17:44.872 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-13T20:17:44.872 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/1901658060,v1:127.0.0.1:6813/1901658060]", 2026-02-13T20:17:44.872 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-13T20:17:44.872 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-13T20:17:44.872 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-13T20:17:44.872 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T20:17:44.872 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-13T20:17:44.872 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T20:17:44.872 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-13T20:17:44.872 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T20:17:44.872 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T20:17:44.873 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T20:17:44.873 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T20:17:44.873 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T20:17:44.873 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-13T20:17:44.873 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T20:17:44.873 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T20:17:44.873 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T20:17:44.873 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T20:17:44.873 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T20:17:44.873 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T20:17:44.873 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-13T20:17:44.873 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-13T20:17:44.873 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:17:44.873 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-13T20:17:44.873 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-13T20:17:44.873 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T20:17:44.873 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-13T20:15:55.560524Z", 2026-02-13T20:17:44.873 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-13T20:17:44.874 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-13T20:17:44.874 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T20:17:44.874 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-13T20:17:44.874 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-13T20:17:44.874 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T20:17:44.874 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-13T20:17:44.874 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/1901658060,v1:127.0.0.1:6811/1901658060]", 2026-02-13T20:17:44.874 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-13T20:17:44.874 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1901658060,v1:127.0.0.1:6817/1901658060]", 2026-02-13T20:17:44.874 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1901658060,v1:127.0.0.1:6815/1901658060]", 2026-02-13T20:17:44.874 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-13T20:17:44.874 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-13T20:17:44.874 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T20:17:44.874 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T20:17:44.874 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-13T20:17:44.874 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961704", 2026-02-13T20:17:44.874 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T20:17:44.874 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-13T20:17:44.874 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-13T20:17:44.875 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-13T20:17:44.875 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/2", 2026-02-13T20:17:44.875 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-13T20:17:44.875 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-13T20:17:44.875 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-13T20:17:44.875 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.875 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:44.875 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_clean_epochs": { 2026-02-13T20:17:44.875 INFO:tasks.workunit.client.0.trial030.stdout: "min_last_epoch_clean": 24, 2026-02-13T20:17:44.875 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": { 2026-02-13T20:17:44.875 INFO:tasks.workunit.client.0.trial030.stdout: "per_pool": [ 2026-02-13T20:17:44.875 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.875 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": 1, 2026-02-13T20:17:44.875 INFO:tasks.workunit.client.0.trial030.stdout: "floor": 24 2026-02-13T20:17:44.875 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.875 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.875 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.875 INFO:tasks.workunit.client.0.trial030.stdout: "osd_epochs": [ 2026-02-13T20:17:44.875 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.875 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:17:44.876 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 46 2026-02-13T20:17:44.876 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.876 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.876 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:17:44.876 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 50 2026-02-13T20:17:44.876 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.876 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.876 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.876 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_first_committed": 1, 2026-02-13T20:17:44.876 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_last_committed": 50, 2026-02-13T20:17:44.876 INFO:tasks.workunit.client.0.trial030.stdout: "crushmap": { 2026-02-13T20:17:44.876 INFO:tasks.workunit.client.0.trial030.stdout: "devices": [ 2026-02-13T20:17:44.876 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.876 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:17:44.876 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.0", 2026-02-13T20:17:44.876 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-13T20:17:44.876 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.876 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.876 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:17:44.876 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.1", 2026-02-13T20:17:44.877 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-13T20:17:44.877 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.877 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.877 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:17:44.877 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.2", 2026-02-13T20:17:44.877 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-13T20:17:44.877 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.877 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:44.877 INFO:tasks.workunit.client.0.trial030.stdout: "types": [ 2026-02-13T20:17:44.877 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.877 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 0, 2026-02-13T20:17:44.877 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd" 2026-02-13T20:17:44.877 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.877 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.877 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-13T20:17:44.877 INFO:tasks.workunit.client.0.trial030.stdout: "name": "host" 2026-02-13T20:17:44.877 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.877 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.877 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 2, 2026-02-13T20:17:44.877 INFO:tasks.workunit.client.0.trial030.stdout: "name": "chassis" 2026-02-13T20:17:44.877 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.878 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.878 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 3, 2026-02-13T20:17:44.878 INFO:tasks.workunit.client.0.trial030.stdout: "name": "rack" 2026-02-13T20:17:44.878 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.878 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.878 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 4, 2026-02-13T20:17:44.878 INFO:tasks.workunit.client.0.trial030.stdout: "name": "row" 2026-02-13T20:17:44.878 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.878 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.878 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 5, 2026-02-13T20:17:44.878 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pdu" 2026-02-13T20:17:44.878 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.878 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.878 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 6, 2026-02-13T20:17:44.878 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pod" 2026-02-13T20:17:44.878 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.878 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.878 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 7, 2026-02-13T20:17:44.878 INFO:tasks.workunit.client.0.trial030.stdout: "name": "room" 2026-02-13T20:17:44.878 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.878 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.879 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 8, 2026-02-13T20:17:44.879 INFO:tasks.workunit.client.0.trial030.stdout: "name": "datacenter" 2026-02-13T20:17:44.879 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.879 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.879 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 9, 2026-02-13T20:17:44.879 INFO:tasks.workunit.client.0.trial030.stdout: "name": "zone" 2026-02-13T20:17:44.879 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.879 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.879 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 10, 2026-02-13T20:17:44.879 INFO:tasks.workunit.client.0.trial030.stdout: "name": "region" 2026-02-13T20:17:44.879 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.879 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.879 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-13T20:17:44.879 INFO:tasks.workunit.client.0.trial030.stdout: "name": "root" 2026-02-13T20:17:44.879 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.879 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:44.879 INFO:tasks.workunit.client.0.trial030.stdout: "buckets": [ 2026-02-13T20:17:44.879 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.879 INFO:tasks.workunit.client.0.trial030.stdout: "id": -1, 2026-02-13T20:17:44.879 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default", 2026-02-13T20:17:44.879 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-13T20:17:44.879 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: "id": -2, 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default~ssd", 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-13T20:17:44.880 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030", 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.881 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030~ssd", 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-13T20:17:44.882 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: "rules": [ 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: "rule_id": 0, 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: "rule_name": "replicated_rule", 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: "steps": [ 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: "op": "take", 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: "item": -1, 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: "item_name": "default" 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: "op": "choose_firstn", 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: "num": 0, 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: "type": "osd" 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.883 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: "op": "emit" 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: "rule_id": 1, 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: "rule_name": "test", 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: "type": 3, 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: "steps": [ 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: "op": "set_chooseleaf_tries", 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: "num": 5 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: "op": "set_choose_tries", 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: "num": 100 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: "op": "take", 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: "item": -1, 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: "item_name": "default" 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.884 INFO:tasks.workunit.client.0.trial030.stdout: "op": "choose_indep", 2026-02-13T20:17:44.885 INFO:tasks.workunit.client.0.trial030.stdout: "num": 0, 2026-02-13T20:17:44.885 INFO:tasks.workunit.client.0.trial030.stderr:report 877602552 2026-02-13T20:17:44.885 INFO:tasks.workunit.client.0.trial030.stdout: "type": "osd" 2026-02-13T20:17:44.885 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.885 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.885 INFO:tasks.workunit.client.0.trial030.stdout: "op": "emit" 2026-02-13T20:17:44.885 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.885 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-13T20:17:44.885 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.885 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:44.885 INFO:tasks.workunit.client.0.trial030.stdout: "tunables": { 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_tries": 0, 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_fallback_tries": 0, 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "choose_total_tries": 50, 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_descend_once": 1, 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_vary_r": 1, 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_stable": 1, 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "msr_descents": 100, 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "msr_collision_tries": 100, 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "straw_calc_version": 1, 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "allowed_bucket_algs": 54, 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "profile": "jewel", 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_tunables": 1, 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "legacy_tunables": 0, 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "minimum_required_version": "jewel", 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables": 1, 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables2": 1, 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "has_v2_rules": 1, 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables3": 1, 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "has_v3_rules": 0, 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "has_v4_buckets": 1, 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables5": 1, 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "has_v5_rules": 0, 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "has_msr_rules": 0 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.886 INFO:tasks.workunit.client.0.trial030.stdout: "choose_args": {} 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: "fsmap": { 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: "btime": "2026-02-13T20:15:46:745898+0000", 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: "default_fscid": -1, 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: "compat": { 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: "compat": {}, 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: "ro_compat": {}, 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: "incompat": { 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: "feature_1": "base v0.20", 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: "feature_2": "client writeable ranges", 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: "feature_3": "default file layouts on dirs", 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: "feature_4": "dir inode in separate object", 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: "feature_5": "mds uses versioned encoding", 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: "feature_8": "no anchor table", 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: "feature_9": "file layout v2", 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: "feature_10": "snaprealm v2", 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: "feature_11": "minor log segments", 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: "feature_12": "quiesce subvolumes" 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: "feature_flags": { 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: "enable_multiple": true, 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: "ever_enabled_multiple": true 2026-02-13T20:17:44.887 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "standbys": [], 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "filesystems": [] 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_first_committed": 1, 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_last_committed": 1, 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "auth": { 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 5, 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "num_secrets": 3 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 1, 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_active": 1, 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_unknown": 0, 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "num_osd": 3, 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "pool_sum": { 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 52200, 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 101, 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 1, 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 303, 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 101, 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 101, 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-13T20:17:44.888 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 101, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 101, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-13T20:17:44.889 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 0, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 0, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 18, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 18, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "up": 3, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 3, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 0 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum": { 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 3, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 85060, 2026-02-13T20:17:44.890 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2260, 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 30, 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 82721, 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314487740, 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322035445760, 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2314240, 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 1595293, 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 30950, 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 84707098 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-13T20:17:44.891 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum_by_class": { 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "ssd": { 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 3, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 85060, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2260, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 30, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 82721, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314487740, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322035445760, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2314240, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 1595293, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 30950, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 84707098 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.892 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "pool_stats": [ 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": 1, 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 1, 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 52200, 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 101, 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 1, 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 303, 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 101, 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-13T20:17:44.893 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 101, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 101, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 101, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-13T20:17:44.894 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 1241088, 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 1241088, 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 18, 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 18, 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "up": 3, 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 3, 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 3 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "osd_stats": [ 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 193273528329 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 38654705679 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.895 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 210453397513 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_state": [ 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: "state": "active+undersized+degraded", 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: "num": 1 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: "pool_pg_unavailable_map": [ 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": "1", 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: "pgs": [] 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_osd": [ 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2147483647, 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 1, 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-13T20:17:44.896 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 0, 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": [ 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": {} 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "servicemap": { 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 3, 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-13T20:16:55.184080+0000", 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "services": { 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "osd": { 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "daemons": { 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "summary": "", 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "0": { 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "start_epoch": 0, 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "start_stamp": "0.000000", 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "gid": 0, 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "metadata": {}, 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "task_status": {} 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "2": { 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "start_epoch": 0, 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "start_stamp": "0.000000", 2026-02-13T20:17:44.897 INFO:tasks.workunit.client.0.trial030.stdout: "gid": 0, 2026-02-13T20:17:44.898 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-13T20:17:44.898 INFO:tasks.workunit.client.0.trial030.stdout: "metadata": {}, 2026-02-13T20:17:44.898 INFO:tasks.workunit.client.0.trial030.stdout: "task_status": {} 2026-02-13T20:17:44.898 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.898 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.898 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.898 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.898 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-13T20:17:44.898 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_first_committed": 1, 2026-02-13T20:17:44.898 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_last_committed": 59, 2026-02-13T20:17:44.898 INFO:tasks.workunit.client.0.trial030.stdout: "logm_first_committed": 1, 2026-02-13T20:17:44.898 INFO:tasks.workunit.client.0.trial030.stdout: "logm_last_committed": 317, 2026-02-13T20:17:44.898 INFO:tasks.workunit.client.0.trial030.stdout: "paxos": { 2026-02-13T20:17:44.898 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-13T20:17:44.898 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 436, 2026-02-13T20:17:44.898 INFO:tasks.workunit.client.0.trial030.stdout: "last_pn": 0, 2026-02-13T20:17:44.898 INFO:tasks.workunit.client.0.trial030.stdout: "accepted_pn": 0 2026-02-13T20:17:44.898 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-13T20:17:44.898 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-13T20:17:44.898 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-13T20:17:44.898 INFO:tasks.workunit.client.0.trial030.stdout:delay recovery 2026-02-13T20:17:44.899 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:341: TEST_divergent_ec: echo 'delay recovery' 2026-02-13T20:17:44.899 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:342: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T20:17:45.057 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:17:45.057 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-13T20:17:10.919399+0000 42'102 50:142 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-13T20:15:59.088125+0000 0'0 2026-02-13T20:15:59.088125+0000 0 0 periodic scrub scheduled @ 2026-02-15T06:47:02.970355+0000 0 0 2026-02-13T20:17:45.057 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:17:45.057 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:17:45.058 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:17:45.066 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2026-02-13T20:17:45.067 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.0 2026-02-13T20:17:45.067 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T20:17:45.067 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T20:17:45.067 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:17:45.067 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:17:45.067 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:17:45.068 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.0.asok 2026-02-13T20:17:45.068 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2026-02-13T20:17:45.068 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.0.asok set_recovery_delay 100000 2026-02-13T20:17:45.125 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T20:17:45.131 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2026-02-13T20:17:45.132 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.2 2026-02-13T20:17:45.132 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-13T20:17:45.132 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-13T20:17:45.132 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:17:45.132 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:17:45.132 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:17:45.133 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.2.asok 2026-02-13T20:17:45.133 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2026-02-13T20:17:45.133 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.2.asok set_recovery_delay 100000 2026-02-13T20:17:45.190 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T20:17:45.196 INFO:tasks.workunit.client.0.trial030.stdout:revive divergent 1 2026-02-13T20:17:45.197 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:349: TEST_divergent_ec: echo 'revive divergent 1' 2026-02-13T20:17:45.197 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:350: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T20:17:45.415 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:17:45.415 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-13T20:17:10.919399+0000 42'102 50:142 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-13T20:15:59.088125+0000 0'0 2026-02-13T20:15:59.088125+0000 0 0 periodic scrub scheduled @ 2026-02-15T06:47:02.970355+0000 0 0 2026-02-13T20:17:45.415 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:17:45.415 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:17:45.415 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:17:45.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:351: TEST_divergent_ec: ceph osd set noup 2026-02-13T20:17:45.754 INFO:tasks.workunit.client.0.trial030.stderr:noup is set 2026-02-13T20:17:45.769 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:352: TEST_divergent_ec: activate_osd td/divergent-priors 1 2026-02-13T20:17:45.770 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T20:17:45.770 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T20:17:45.770 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T20:17:45.770 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T20:17:45.770 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-13T20:17:45.770 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:17:45.771 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:17:45.771 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:17:45.771 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:17:45.771 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T20:17:45.771 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T20:17:45.771 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T20:17:45.771 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T20:17:45.771 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:17:45.771 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T20:17:45.772 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:17:45.772 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:17:45.772 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:17:45.772 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:17:45.772 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:17:45.772 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:17:45.772 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:17:45.772 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:17:45.773 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:17:45.773 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:17:45.773 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:17:45.773 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:17:45.773 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:17:45.773 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:17:45.773 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T20:17:45.773 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T20:17:45.773 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-13T20:17:45.774 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T20:17:45.774 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-13T20:17:45.775 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:17:45.775 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-13T20:17:45.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T20:17:45.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T20:17:45.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T20:17:45.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T20:17:45.793 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:17:45.792+0000 7fb6a230da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:17:45.795 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:17:45.792+0000 7fb6a230da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:17:45.796 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:17:45.792+0000 7fb6a230da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:17:45.993 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-13T20:17:45.993 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:353: TEST_divergent_ec: sleep 5 2026-02-13T20:17:46.147 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:17:46.144+0000 7fb6a230da40 -1 Falling back to public interface 2026-02-13T20:17:46.739 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:17:46.736+0000 7fb6a230da40 -1 osd.1 28 log_to_monitors true 2026-02-13T20:17:50.994 INFO:tasks.workunit.client.0.trial030.stdout:delay recovery divergent 2026-02-13T20:17:50.994 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:355: TEST_divergent_ec: echo 'delay recovery divergent' 2026-02-13T20:17:50.994 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:356: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T20:17:51.200 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:17:51.200 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-13T20:17:10.919399+0000 42'102 53:148 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-13T20:15:59.088125+0000 0'0 2026-02-13T20:15:59.088125+0000 0 0 periodic scrub scheduled @ 2026-02-15T06:47:02.970355+0000 0 0 2026-02-13T20:17:51.200 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:17:51.201 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:17:51.201 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:17:51.210 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: get_asok_path osd.1 2026-02-13T20:17:51.210 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T20:17:51.210 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T20:17:51.210 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:17:51.210 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:17:51.210 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:17:51.211 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19555/ceph-osd.1.asok 2026-02-13T20:17:51.211 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: CEPH_ARGS= 2026-02-13T20:17:51.211 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.19555/ceph-osd.1.asok set_recovery_delay 100000 2026-02-13T20:17:51.269 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T20:17:51.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:359: TEST_divergent_ec: ceph osd unset noup 2026-02-13T20:17:51.599 INFO:tasks.workunit.client.0.trial030.stderr:noup is unset 2026-02-13T20:17:51.612 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:361: TEST_divergent_ec: wait_for_osd up 0 2026-02-13T20:17:51.612 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:17:51.612 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T20:17:51.613 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:17:51.613 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:17:51.613 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:17:51.613 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:17:51.614 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:17:51.614 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:17:51.614 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:17:51.834 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 45 up_thru 49 down_at 44 last_clean_interval [35,42) [v2:127.0.0.1:6800/1411078054,v1:127.0.0.1:6801/1411078054] [v2:127.0.0.1:6802/1411078054,v1:127.0.0.1:6803/1411078054] exists,up f07a9a5d-5587-496d-ae5a-150352e2c1fc 2026-02-13T20:17:51.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:17:51.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:17:51.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:17:51.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:362: TEST_divergent_ec: wait_for_osd up 1 2026-02-13T20:17:51.835 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:17:51.835 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T20:17:51.835 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:17:51.835 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:17:51.835 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:17:51.835 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:17:51.835 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:17:51.835 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:17:51.835 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:17:52.050 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 55 up_thru 55 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/1520904835,v1:127.0.0.1:6819/1520904835] [v2:127.0.0.1:6820/1520904835,v1:127.0.0.1:6821/1520904835] exists,up c7c6b311-7783-4c87-a03d-8e96a204ca78 2026-02-13T20:17:52.051 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:17:52.051 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:17:52.051 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:17:52.051 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:363: TEST_divergent_ec: wait_for_osd up 2 2026-02-13T20:17:52.051 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:17:52.051 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T20:17:52.051 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:17:52.051 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:17:52.051 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:17:52.052 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:17:52.052 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:17:52.052 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:17:52.052 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:17:52.266 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 49 up_thru 0 down_at 48 last_clean_interval [38,42) [v2:127.0.0.1:6810/1901658060,v1:127.0.0.1:6811/1901658060] [v2:127.0.0.1:6812/1901658060,v1:127.0.0.1:6813/1901658060] exists,up 3a006542-89c5-41a2-bd52-742aba707d2e 2026-02-13T20:17:52.267 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:17:52.267 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:17:52.268 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:17:52.268 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:365: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T20:17:52.476 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:17:52.476 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-13T20:17:10.919399+0000 42'102 53:148 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-13T20:15:59.088125+0000 0'0 2026-02-13T20:15:59.088125+0000 0 0 periodic scrub scheduled @ 2026-02-15T06:47:02.970355+0000 0 0 2026-02-13T20:17:52.476 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:17:52.476 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:17:52.477 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:17:52.485 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:366: TEST_divergent_ec: echo 'wait for peering' 2026-02-13T20:17:52.485 INFO:tasks.workunit.client.0.trial030.stdout:wait for peering 2026-02-13T20:17:52.485 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:367: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T20:17:52.705 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:17:52.705 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-13T20:17:10.919399+0000 42'102 53:148 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-13T20:15:59.088125+0000 0'0 2026-02-13T20:15:59.088125+0000 0 0 periodic scrub scheduled @ 2026-02-15T06:47:02.970355+0000 0 0 2026-02-13T20:17:52.705 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:17:52.705 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:17:52.705 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:17:52.713 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:368: TEST_divergent_ec: rados -p test put foo /tmp/tmp.0WF00CV70Z 2026-02-13T20:17:52.736 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:369: TEST_divergent_ec: rm -f /tmp/tmp.0WF00CV70Z 2026-02-13T20:17:52.736 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:371: TEST_divergent_ec: echo 'killing divergent 1' 2026-02-13T20:17:52.737 INFO:tasks.workunit.client.0.trial030.stdout:killing divergent 1 2026-02-13T20:17:52.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:372: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T20:17:52.942 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:17:52.942 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-13T20:17:10.919399+0000 42'102 53:148 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-13T20:15:59.088125+0000 0'0 2026-02-13T20:15:59.088125+0000 0 0 periodic scrub scheduled @ 2026-02-15T06:47:02.970355+0000 0 0 2026-02-13T20:17:52.942 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:17:52.942 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:17:52.942 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:17:52.950 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:373: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.1 2026-02-13T20:17:52.952 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:17:52.952 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:17:52.952 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:17:52.952 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:17:52.952 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:17:53.060 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:17:53.060 INFO:tasks.workunit.client.0.trial030.stdout:reviving divergent 1 2026-02-13T20:17:53.061 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:375: TEST_divergent_ec: echo 'reviving divergent 1' 2026-02-13T20:17:53.061 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:376: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T20:17:53.259 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:17:53.259 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 peering 2026-02-13T20:17:51.600288+0000 28'104 55:128 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:15:59.088125+0000 0'0 2026-02-13T20:15:59.088125+0000 0 0 no scrub is scheduled 0 0 2026-02-13T20:17:53.259 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:17:53.259 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:17:53.260 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:17:53.270 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:377: TEST_divergent_ec: activate_osd td/divergent-priors 1 2026-02-13T20:17:53.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T20:17:53.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T20:17:53.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T20:17:53.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T20:17:53.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-13T20:17:53.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T20:17:53.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:17:53.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:17:53.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:17:53.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T20:17:53.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T20:17:53.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T20:17:53.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T20:17:53.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T20:17:53.272 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T20:17:53.272 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:17:53.272 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:17:53.272 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:17:53.273 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:17:53.273 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:17:53.273 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:17:53.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' 2026-02-13T20:17:53.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:17:53.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T20:17:53.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T20:17:53.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:17:53.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:17:53.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:17:53.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:17:53.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T20:17:53.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T20:17:53.274 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-13T20:17:53.274 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-13T20:17:53.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T20:17:53.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=76a1de22-3326-43d1-82f4-48cedec81b31 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19555/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:17:53.275 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-13T20:17:53.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T20:17:53.276 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T20:17:53.276 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T20:17:53.276 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T20:17:53.298 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:17:53.295+0000 7fb262fbda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:17:53.299 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:17:53.295+0000 7fb262fbda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:17:53.300 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:17:53.295+0000 7fb262fbda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:17:53.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-13T20:17:53.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:17:53.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T20:17:53.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:17:53.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:17:53.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:17:53.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:17:53.493 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:17:53.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:17:53.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:17:53.711 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 55 up_thru 55 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/1520904835,v1:127.0.0.1:6819/1520904835] [v2:127.0.0.1:6820/1520904835,v1:127.0.0.1:6821/1520904835] exists,up c7c6b311-7783-4c87-a03d-8e96a204ca78 2026-02-13T20:17:53.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:17:53.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:17:53.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:17:53.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:379: TEST_divergent_ec: sleep 20 2026-02-13T20:17:53.739 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:17:53.735+0000 7fb262fbda40 -1 Falling back to public interface 2026-02-13T20:17:54.309 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:17:54.303+0000 7fb262fbda40 -1 osd.1 56 log_to_monitors true 2026-02-13T20:18:13.713 INFO:tasks.workunit.client.0.trial030.stdout:allowing recovery 2026-02-13T20:18:13.714 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:381: TEST_divergent_ec: echo 'allowing recovery' 2026-02-13T20:18:13.714 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:382: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T20:18:13.922 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:18:13.922 INFO:tasks.workunit.client.0.trial030.stdout:1.0 102 0 0 0 0 52712 0 0 13 90 13 active+clean 2026-02-13T20:17:54.677318+0000 56'103 60:160 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:15:59.088125+0000 0'0 2026-02-13T20:15:59.088125+0000 0 0 periodic scrub scheduled @ 2026-02-15T02:58:13.985672+0000 0 0 2026-02-13T20:18:13.922 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:18:13.923 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:18:13.923 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:18:13.933 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-13T20:18:13.933 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-13T20:18:14.007 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T20:18:14.016 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-13T20:18:14.016 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-13T20:18:14.091 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T20:18:14.098 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-13T20:18:14.098 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-13T20:18:14.182 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T20:18:14.192 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:389: TEST_divergent_ec: echo 'reading divergent objects' 2026-02-13T20:18:14.192 INFO:tasks.workunit.client.0.trial030.stdout:reading divergent objects 2026-02-13T20:18:14.193 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:390: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T20:18:14.393 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T20:18:14.393 INFO:tasks.workunit.client.0.trial030.stdout:1.0 102 0 0 0 0 52712 0 0 13 90 13 active+clean 2026-02-13T20:17:54.677318+0000 56'103 60:160 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T20:15:59.088125+0000 0'0 2026-02-13T20:15:59.088125+0000 0 0 periodic scrub scheduled @ 2026-02-15T02:58:13.985672+0000 0 0 2026-02-13T20:18:14.393 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-13T20:18:14.393 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T20:18:14.394 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-13T20:18:14.403 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: expr 2 + 2 2026-02-13T20:18:14.404 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: seq 1 4 2026-02-13T20:18:14.405 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T20:18:14.405 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_1 td/divergent-priors/existing 2026-02-13T20:18:14.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T20:18:14.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_2 td/divergent-priors/existing 2026-02-13T20:18:14.453 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T20:18:14.453 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_3 td/divergent-priors/existing 2026-02-13T20:18:14.479 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T20:18:14.479 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_4 td/divergent-priors/existing 2026-02-13T20:18:14.507 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:395: TEST_divergent_ec: rm -f td/divergent-priors/existing 2026-02-13T20:18:14.509 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:397: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2026-02-13T20:18:14.510 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:397: TEST_divergent_ec: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-13T20:18:14.514 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:1 entries: 28'103 (27'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2026-02-13T20:16:12.435571+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-13T20:18:14.514 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 20 _merge_object_divergent_entries: keeping 28'103 (27'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2026-02-13T20:16:12.435571+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-13T20:18:14.514 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T20:18:14.514 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version: 27'99 first_divergent_update: 28'103 last_divergent_update: 28'103 2026-02-13T20:18:14.514 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 has no more recent entries in log 2026-02-13T20:18:14.514 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version or op type indicates creation, deleting 2026-02-13T20:18:14.514 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:head entries: 28'104 (27'99) modify 1:7a80c0d5:::existing_99:head by client.4563.0:1 2026-02-13T20:16:17.355916+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-13T20:18:14.514 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 20 _merge_object_divergent_entries: keeping 28'104 (27'99) modify 1:7a80c0d5:::existing_99:head by client.4563.0:1 2026-02-13T20:16:17.355916+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-13T20:18:14.514 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T20:18:14.514 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head prior_version: 27'99 first_divergent_update: 28'104 last_divergent_update: 28'104 2026-02-13T20:18:14.514 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head has no more recent entries in log 2026-02-13T20:18:14.514 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head must be rolled back or recovered, attempting to rollback 2026-02-13T20:18:14.514 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head olog_can_rollback_to: 28'104 2026-02-13T20:18:14.514 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot rollback 28'104 (27'99) modify 1:7a80c0d5:::existing_99:head by client.4563.0:1 2026-02-13T20:16:17.355916+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-13T20:18:14.514 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot roll back, removing and adding to missing 2026-02-13T20:18:14.516 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 27'101 (27'100) modify 1:c156033e:::existing_100:head by client.4554.0:1 2026-02-13T20:16:16.255510+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false,27'102 (27'101) modify 1:c156033e:::existing_100:head by client.4560.0:1 2026-02-13T20:16:17.253487+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T20:18:14.516 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 20 _merge_object_divergent_entries: keeping 27'101 (27'100) modify 1:c156033e:::existing_100:head by client.4554.0:1 2026-02-13T20:16:16.255510+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T20:18:14.516 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 20 _merge_object_divergent_entries: keeping 27'102 (27'101) modify 1:c156033e:::existing_100:head by client.4560.0:1 2026-02-13T20:16:17.253487+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T20:18:14.516 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T20:18:14.516 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 27'100 first_divergent_update: 27'101 last_divergent_update: 27'102 2026-02-13T20:18:14.516 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2026-02-13T20:18:14.516 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2026-02-13T20:18:14.516 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 28'104 2026-02-13T20:18:14.516 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 27'102 (27'101) modify 1:c156033e:::existing_100:head by client.4560.0:1 2026-02-13T20:16:17.253487+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T20:18:14.516 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-13T20:17:51.931+0000 7fb68028b640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2026-02-13T20:18:14.516 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:406: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2026-02-13T20:18:14.517 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:406: TEST_divergent_ec: grep -q '_merge_object_divergent_entries.*rolled back' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-13T20:18:14.521 INFO:tasks.workunit.client.0.trial030.stdout:success 2026-02-13T20:18:14.522 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:411: TEST_divergent_ec: echo success 2026-02-13T20:18:14.522 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:413: TEST_divergent_ec: delete_pool test 2026-02-13T20:18:14.522 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-13T20:18:14.522 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-13T20:18:14.784 INFO:tasks.workunit.client.0.trial030.stderr:pool 'test' does not exist 2026-02-13T20:18:14.794 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:414: TEST_divergent_ec: kill_daemons td/divergent-priors 2026-02-13T20:18:14.795 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:18:14.795 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:18:14.795 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:18:14.795 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:18:14.796 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:18:20.124 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:18:20.124 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-13T20:18:20.124 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-13T20:18:20.124 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T20:18:20.124 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-13T20:18:20.124 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:18:20.124 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:18:20.124 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:18:20.125 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:18:20.125 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:18:20.125 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:18:20.125 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T20:18:20.125 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T20:18:20.125 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T20:18:20.125 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T20:18:20.125 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T20:18:20.125 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T20:18:20.126 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:18:20.127 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T20:18:20.127 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T20:18:20.127 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:18:20.127 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:18:20.128 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T20:18:20.128 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-13T20:18:20.148 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T20:18:20.149 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:20.149 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:18:20.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19555 2026-02-13T20:18:20.150 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T20:18:20.150 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T20:18:20.150 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-13T20:18:20.151 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/divergent-priors 0 2026-02-13T20:18:20.151 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-13T20:18:20.151 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-13T20:18:20.151 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-13T20:18:20.151 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:18:20.151 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:18:20.152 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:18:20.152 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:18:20.152 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:18:20.153 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:18:20.154 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T20:18:20.154 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T20:18:20.155 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T20:18:20.156 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T20:18:20.156 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T20:18:20.157 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T20:18:20.158 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:18:20.158 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T20:18:20.158 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T20:18:20.159 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:18:20.159 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:18:20.160 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-13T20:18:20.160 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-13T20:18:20.162 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T20:18:20.162 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:20.162 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19555 2026-02-13T20:18:20.162 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19555 2026-02-13T20:18:20.163 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T20:18:20.164 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T20:18:20.164 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-13T20:18:20.164 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-13T20:18:20.165 DEBUG:teuthology.orchestra.run.trial030:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-13T20:18:20.214 INFO:tasks.workunit:Running workunit osd/ec-error-rollforward.sh... 2026-02-13T20:18:20.214 DEBUG:teuthology.orchestra.run.trial030:workunit test osd/ec-error-rollforward.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=afefaa40503a4bf024e96f97dd7f852b75f00ad6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh 2026-02-13T20:18:20.266 INFO:tasks.workunit.client.0.trial030.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-13T20:18:20.269 INFO:tasks.workunit.client.0.trial030.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-13T20:18:20.269 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-13T20:18:20.269 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-13T20:18:20.269 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-13T20:18:20.269 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-13T20:18:20.269 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-13T20:18:20.269 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-13T20:18:20.269 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-13T20:18:20.269 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-13T20:18:20.269 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/ec-error-rollforward 2026-02-13T20:18:20.270 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:6: run: local dir=td/ec-error-rollforward 2026-02-13T20:18:20.270 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:7: run: shift 2026-02-13T20:18:20.270 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: export CEPH_MON=127.0.0.1:7132 2026-02-13T20:18:20.270 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: CEPH_MON=127.0.0.1:7132 2026-02-13T20:18:20.270 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:11: run: export CEPH_ARGS 2026-02-13T20:18:20.270 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: uuidgen 2026-02-13T20:18:20.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: CEPH_ARGS+='--fsid=32d6b623-71b2-465b-b107-b7507cb4b765 --auth-supported=none ' 2026-02-13T20:18:20.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:13: run: CEPH_ARGS+='--mon-host=127.0.0.1:7132 ' 2026-02-13T20:18:20.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: export margin=10 2026-02-13T20:18:20.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: margin=10 2026-02-13T20:18:20.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: export objects=200 2026-02-13T20:18:20.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: objects=200 2026-02-13T20:18:20.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: export poolname=test 2026-02-13T20:18:20.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: poolname=test 2026-02-13T20:18:20.271 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: set 2026-02-13T20:18:20.271 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-13T20:18:20.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: local funcs=TEST_ec_error_rollforward 2026-02-13T20:18:20.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:19: run: for func in $funcs 2026-02-13T20:18:20.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:20: run: setup td/ec-error-rollforward 2026-02-13T20:18:20.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ec-error-rollforward 2026-02-13T20:18:20.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ec-error-rollforward 2026-02-13T20:18:20.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-13T20:18:20.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T20:18:20.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-13T20:18:20.274 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:18:20.274 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:18:20.274 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:18:20.274 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:18:20.274 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:18:20.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:18:20.276 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T20:18:20.276 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T20:18:20.277 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T20:18:20.277 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T20:18:20.277 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T20:18:20.278 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T20:18:20.279 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:18:20.279 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T20:18:20.279 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T20:18:20.279 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:18:20.280 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:18:20.281 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T20:18:20.281 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-13T20:18:20.282 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T20:18:20.282 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:20.282 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75350 2026-02-13T20:18:20.282 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.75350 2026-02-13T20:18:20.283 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T20:18:20.284 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T20:18:20.284 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ec-error-rollforward 2026-02-13T20:18:20.285 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T20:18:20.285 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:20.285 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75350 2026-02-13T20:18:20.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.75350 2026-02-13T20:18:20.286 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T20:18:20.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-13T20:18:20.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-13T20:18:20.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T20:18:20.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ec-error-rollforward 1' TERM HUP INT 2026-02-13T20:18:20.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:21: run: TEST_ec_error_rollforward td/ec-error-rollforward 2026-02-13T20:18:20.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:27: TEST_ec_error_rollforward: local dir=td/ec-error-rollforward 2026-02-13T20:18:20.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:28: TEST_ec_error_rollforward: run_mon td/ec-error-rollforward a 2026-02-13T20:18:20.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ec-error-rollforward 2026-02-13T20:18:20.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T20:18:20.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T20:18:20.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T20:18:20.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ec-error-rollforward/a 2026-02-13T20:18:20.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ec-error-rollforward/a --run-dir=td/ec-error-rollforward 2026-02-13T20:18:20.319 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T20:18:20.319 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:18:20.319 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:18:20.320 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:18:20.320 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:20.320 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75350 2026-02-13T20:18:20.320 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.75350/$cluster-$name.asok' 2026-02-13T20:18:20.320 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ec-error-rollforward/a '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.75350/$cluster-$name.asok' --mon-cluster-log-file=td/ec-error-rollforward/log --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T20:18:20.353 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T20:18:20.356 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T20:18:20.356 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T20:18:20.357 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T20:18:20.357 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T20:18:20.357 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T20:18:20.357 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T20:18:20.357 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T20:18:20.357 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T20:18:20.358 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:18:20.358 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:20.358 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75350 2026-02-13T20:18:20.358 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.75350/ceph-mon.a.asok 2026-02-13T20:18:20.358 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T20:18:20.358 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.75350/ceph-mon.a.asok config get fsid 2026-02-13T20:18:20.411 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T20:18:20.412 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T20:18:20.412 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T20:18:20.412 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T20:18:20.412 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T20:18:20.412 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T20:18:20.412 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T20:18:20.412 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T20:18:20.412 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:18:20.412 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:20.412 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75350 2026-02-13T20:18:20.412 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.75350/ceph-mon.a.asok 2026-02-13T20:18:20.413 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T20:18:20.413 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.75350/ceph-mon.a.asok config get mon_host 2026-02-13T20:18:20.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:29: TEST_ec_error_rollforward: run_mgr td/ec-error-rollforward x 2026-02-13T20:18:20.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ec-error-rollforward 2026-02-13T20:18:20.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T20:18:20.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T20:18:20.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T20:18:20.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ec-error-rollforward/x 2026-02-13T20:18:20.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T20:18:20.579 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T20:18:20.579 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:18:20.579 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:18:20.579 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:18:20.579 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:20.579 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75350 2026-02-13T20:18:20.579 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.75350/$cluster-$name.asok' 2026-02-13T20:18:20.580 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T20:18:20.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ec-error-rollforward/x '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.75350/$cluster-$name.asok' --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T20:18:20.600 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:30: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 0 2026-02-13T20:18:20.600 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-13T20:18:20.600 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:18:20.600 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T20:18:20.600 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:18:20.600 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/0 2026-02-13T20:18:20.600 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=32d6b623-71b2-465b-b107-b7507cb4b765 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-13T20:18:20.600 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:18:20.600 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:18:20.600 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:18:20.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2026-02-13T20:18:20.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2026-02-13T20:18:20.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:18:20.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:18:20.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-13T20:18:20.601 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:18:20.601 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:18:20.601 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:18:20.601 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:18:20.601 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:20.601 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75350 2026-02-13T20:18:20.601 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.75350/$cluster-$name.asok' 2026-02-13T20:18:20.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.75350/$cluster-$name.asok' 2026-02-13T20:18:20.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:18:20.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:18:20.602 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:18:20.602 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-13T20:18:20.602 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-13T20:18:20.602 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:18:20.602 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:18:20.602 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:18:20.602 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:18:20.602 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:18:20.602 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:18:20.602 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/0 2026-02-13T20:18:20.603 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:18:20.603 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=eed92632-1b86-4997-adc2-8304fba3b065 2026-02-13T20:18:20.603 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 eed92632-1b86-4997-adc2-8304fba3b065' 2026-02-13T20:18:20.603 INFO:tasks.workunit.client.0.trial030.stdout:add osd0 eed92632-1b86-4997-adc2-8304fba3b065 2026-02-13T20:18:20.603 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:18:20.612 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAMh49p4nhhJBAAsmszEQRfglT2hgIYzqNPFw== 2026-02-13T20:18:20.612 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAMh49p4nhhJBAAsmszEQRfglT2hgIYzqNPFw=="}' 2026-02-13T20:18:20.612 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new eed92632-1b86-4997-adc2-8304fba3b065 -i td/ec-error-rollforward/0/new.json 2026-02-13T20:18:20.721 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:18:20.728 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/0/new.json 2026-02-13T20:18:20.730 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=32d6b623-71b2-465b-b107-b7507cb4b765 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75350/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAMh49p4nhhJBAAsmszEQRfglT2hgIYzqNPFw== --osd-uuid eed92632-1b86-4997-adc2-8304fba3b065 2026-02-13T20:18:20.744 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:20.738+0000 7f05b0b8fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:20.745 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:20.738+0000 7f05b0b8fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:20.746 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:20.742+0000 7f05b0b8fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:20.747 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:20.742+0000 7f05b0b8fa40 -1 bdev(0x556879cf4400 td/ec-error-rollforward/0/block) open stat got: (1) Operation not permitted 2026-02-13T20:18:20.747 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:20.742+0000 7f05b0b8fa40 -1 bluestore(td/ec-error-rollforward/0) _read_fsid unparsable uuid 2026-02-13T20:18:21.509 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/0/keyring 2026-02-13T20:18:21.510 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:18:21.510 INFO:tasks.workunit.client.0.trial030.stdout:adding osd0 key to auth repository 2026-02-13T20:18:21.511 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T20:18:21.511 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:18:21.635 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-13T20:18:21.635 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T20:18:21.635 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=32d6b623-71b2-465b-b107-b7507cb4b765 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75350/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:18:21.635 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:18:21.635 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:18:21.635 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:18:21.658 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:21.654+0000 7f7afded2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:21.660 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:21.654+0000 7f7afded2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:21.662 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:21.658+0000 7f7afded2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:21.744 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T20:18:21.744 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:18:21.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T20:18:21.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:18:21.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:18:21.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:21.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:18:21.745 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:18:21.746 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:21.746 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:18:21.855 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:18:22.231 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:22.226+0000 7f7afded2a40 -1 Falling back to public interface 2026-02-13T20:18:22.856 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:18:22.856 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:22.857 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:18:22.857 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:18:22.857 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:22.858 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:18:22.961 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:18:23.180 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:23.174+0000 7f7afded2a40 -1 osd.0 0 log_to_monitors true 2026-02-13T20:18:23.962 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:18:23.963 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:23.963 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:18:23.964 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T20:18:23.964 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:23.964 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:18:24.175 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2142927957,v1:127.0.0.1:6801/2142927957] [v2:127.0.0.1:6802/2142927957,v1:127.0.0.1:6803/2142927957] exists,up eed92632-1b86-4997-adc2-8304fba3b065 2026-02-13T20:18:24.178 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:18:24.179 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:18:24.179 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:18:24.179 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:31: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 1 2026-02-13T20:18:24.179 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-13T20:18:24.179 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:18:24.179 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T20:18:24.179 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:18:24.179 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/1 2026-02-13T20:18:24.179 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=32d6b623-71b2-465b-b107-b7507cb4b765 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-13T20:18:24.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:18:24.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:18:24.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:18:24.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2026-02-13T20:18:24.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2026-02-13T20:18:24.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:18:24.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:18:24.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-13T20:18:24.180 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:18:24.180 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:18:24.180 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:18:24.180 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:18:24.181 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:24.181 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75350 2026-02-13T20:18:24.181 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.75350/$cluster-$name.asok' 2026-02-13T20:18:24.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.75350/$cluster-$name.asok' 2026-02-13T20:18:24.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:18:24.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:18:24.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:18:24.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-13T20:18:24.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-13T20:18:24.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:18:24.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:18:24.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:18:24.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:18:24.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:18:24.182 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:18:24.182 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/1 2026-02-13T20:18:24.182 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:18:24.182 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f00dfd47-2e38-4ad5-b26b-d225df701824 2026-02-13T20:18:24.183 INFO:tasks.workunit.client.0.trial030.stdout:add osd1 f00dfd47-2e38-4ad5-b26b-d225df701824 2026-02-13T20:18:24.183 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 f00dfd47-2e38-4ad5-b26b-d225df701824' 2026-02-13T20:18:24.183 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:18:24.191 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAQh49pVXZLCxAAeT4LQtRj+32D/W36xaWF2Q== 2026-02-13T20:18:24.191 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAQh49pVXZLCxAAeT4LQtRj+32D/W36xaWF2Q=="}' 2026-02-13T20:18:24.191 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f00dfd47-2e38-4ad5-b26b-d225df701824 -i td/ec-error-rollforward/1/new.json 2026-02-13T20:18:24.409 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:18:24.420 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/1/new.json 2026-02-13T20:18:24.421 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=32d6b623-71b2-465b-b107-b7507cb4b765 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75350/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAQh49pVXZLCxAAeT4LQtRj+32D/W36xaWF2Q== --osd-uuid f00dfd47-2e38-4ad5-b26b-d225df701824 2026-02-13T20:18:24.443 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:24.438+0000 7f53ecb20a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:24.444 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:24.438+0000 7f53ecb20a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:24.445 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:24.438+0000 7f53ecb20a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:24.446 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:24.442+0000 7f53ecb20a40 -1 bdev(0x55753d4b6400 td/ec-error-rollforward/1/block) open stat got: (1) Operation not permitted 2026-02-13T20:18:24.446 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:24.442+0000 7f53ecb20a40 -1 bluestore(td/ec-error-rollforward/1) _read_fsid unparsable uuid 2026-02-13T20:18:25.101 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/1/keyring 2026-02-13T20:18:25.101 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:18:25.102 INFO:tasks.workunit.client.0.trial030.stdout:adding osd1 key to auth repository 2026-02-13T20:18:25.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T20:18:25.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:18:25.401 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T20:18:25.401 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-13T20:18:25.402 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=32d6b623-71b2-465b-b107-b7507cb4b765 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75350/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:18:25.402 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:18:25.402 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:18:25.402 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:18:25.423 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:25.418+0000 7f22858e1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:25.424 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:25.418+0000 7f22858e1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:25.425 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:25.418+0000 7f22858e1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:25.612 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T20:18:25.613 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:18:25.613 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T20:18:25.613 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:18:25.613 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:18:25.613 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:25.613 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:18:25.614 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:18:25.614 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:25.614 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:18:25.824 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:18:25.883 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:25.878+0000 7f22858e1a40 -1 Falling back to public interface 2026-02-13T20:18:26.495 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:26.490+0000 7f22858e1a40 -1 osd.1 0 log_to_monitors true 2026-02-13T20:18:26.825 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:18:26.826 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:26.826 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:18:26.826 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:18:26.827 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:26.827 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:18:27.046 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:18:28.048 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:18:28.048 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:28.048 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:18:28.049 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T20:18:28.049 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:28.049 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:18:28.260 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/760897442,v1:127.0.0.1:6811/760897442] [v2:127.0.0.1:6812/760897442,v1:127.0.0.1:6813/760897442] exists,up f00dfd47-2e38-4ad5-b26b-d225df701824 2026-02-13T20:18:28.263 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:18:28.263 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:18:28.263 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:18:28.263 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:32: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 2 2026-02-13T20:18:28.263 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-13T20:18:28.263 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:18:28.263 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T20:18:28.263 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:18:28.264 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/2 2026-02-13T20:18:28.264 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=32d6b623-71b2-465b-b107-b7507cb4b765 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-13T20:18:28.264 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:18:28.264 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:18:28.264 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:18:28.264 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2026-02-13T20:18:28.264 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2026-02-13T20:18:28.264 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:18:28.264 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:18:28.264 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-13T20:18:28.264 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:18:28.264 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:18:28.265 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:18:28.265 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:18:28.265 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:28.265 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75350 2026-02-13T20:18:28.265 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.75350/$cluster-$name.asok' 2026-02-13T20:18:28.265 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.75350/$cluster-$name.asok' 2026-02-13T20:18:28.265 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:18:28.265 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:18:28.265 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:18:28.265 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-13T20:18:28.265 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-13T20:18:28.265 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:18:28.266 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:18:28.266 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:18:28.266 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:18:28.266 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:18:28.266 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:18:28.266 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/2 2026-02-13T20:18:28.267 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:18:28.267 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0c798e0c-6d16-4d55-b213-0d7f32766055 2026-02-13T20:18:28.267 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 0c798e0c-6d16-4d55-b213-0d7f32766055' 2026-02-13T20:18:28.267 INFO:tasks.workunit.client.0.trial030.stdout:add osd2 0c798e0c-6d16-4d55-b213-0d7f32766055 2026-02-13T20:18:28.268 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:18:28.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAUh49p44lOEBAAX8J21LEWXnyxJWxwOHJC+A== 2026-02-13T20:18:28.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAUh49p44lOEBAAX8J21LEWXnyxJWxwOHJC+A=="}' 2026-02-13T20:18:28.276 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0c798e0c-6d16-4d55-b213-0d7f32766055 -i td/ec-error-rollforward/2/new.json 2026-02-13T20:18:28.487 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:18:28.496 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/2/new.json 2026-02-13T20:18:28.497 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=32d6b623-71b2-465b-b107-b7507cb4b765 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75350/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAUh49p44lOEBAAX8J21LEWXnyxJWxwOHJC+A== --osd-uuid 0c798e0c-6d16-4d55-b213-0d7f32766055 2026-02-13T20:18:28.513 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:28.506+0000 7fc204ecda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:28.515 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:28.510+0000 7fc204ecda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:28.516 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:28.510+0000 7fc204ecda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:28.516 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:28.510+0000 7fc204ecda40 -1 bdev(0x55adab250400 td/ec-error-rollforward/2/block) open stat got: (1) Operation not permitted 2026-02-13T20:18:28.516 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:28.510+0000 7fc204ecda40 -1 bluestore(td/ec-error-rollforward/2) _read_fsid unparsable uuid 2026-02-13T20:18:29.137 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/2/keyring 2026-02-13T20:18:29.137 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:18:29.138 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T20:18:29.138 INFO:tasks.workunit.client.0.trial030.stdout:adding osd2 key to auth repository 2026-02-13T20:18:29.138 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:18:29.423 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-13T20:18:29.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T20:18:29.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=32d6b623-71b2-465b-b107-b7507cb4b765 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75350/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:18:29.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:18:29.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:18:29.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:18:29.439 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:29.434+0000 7f9dca104a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:29.440 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:29.434+0000 7f9dca104a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:29.441 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:29.434+0000 7f9dca104a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:29.630 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T20:18:29.630 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:18:29.630 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T20:18:29.630 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:18:29.630 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:18:29.630 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:29.630 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:18:29.630 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:18:29.630 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:29.630 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:18:29.844 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:18:29.887 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:29.882+0000 7f9dca104a40 -1 Falling back to public interface 2026-02-13T20:18:30.500 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:30.494+0000 7f9dca104a40 -1 osd.2 0 log_to_monitors true 2026-02-13T20:18:30.845 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:18:30.845 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:30.846 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:18:30.846 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:18:30.846 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:30.846 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:18:31.053 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:18:32.054 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:18:32.055 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:32.055 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:18:32.055 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T20:18:32.055 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:32.055 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:18:32.258 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/4083582923,v1:127.0.0.1:6819/4083582923] [v2:127.0.0.1:6820/4083582923,v1:127.0.0.1:6821/4083582923] exists,up 0c798e0c-6d16-4d55-b213-0d7f32766055 2026-02-13T20:18:32.258 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:18:32.258 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:18:32.258 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:18:32.258 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:33: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 3 2026-02-13T20:18:32.258 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-13T20:18:32.258 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:18:32.258 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-13T20:18:32.259 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:18:32.259 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/3 2026-02-13T20:18:32.259 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=32d6b623-71b2-465b-b107-b7507cb4b765 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-13T20:18:32.259 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:18:32.259 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:18:32.259 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:18:32.259 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2026-02-13T20:18:32.259 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2026-02-13T20:18:32.259 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:18:32.259 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:18:32.259 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-13T20:18:32.259 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:18:32.259 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:18:32.259 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:18:32.259 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:18:32.259 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:32.259 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75350 2026-02-13T20:18:32.259 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.75350/$cluster-$name.asok' 2026-02-13T20:18:32.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.75350/$cluster-$name.asok' 2026-02-13T20:18:32.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:18:32.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:18:32.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:18:32.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-13T20:18:32.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-13T20:18:32.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:18:32.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:18:32.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:18:32.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:18:32.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:18:32.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:18:32.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/3 2026-02-13T20:18:32.261 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:18:32.262 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0b3fb1d9-4d7d-48ef-b76b-dd8a2a7fac54 2026-02-13T20:18:32.262 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 0b3fb1d9-4d7d-48ef-b76b-dd8a2a7fac54' 2026-02-13T20:18:32.262 INFO:tasks.workunit.client.0.trial030.stdout:add osd3 0b3fb1d9-4d7d-48ef-b76b-dd8a2a7fac54 2026-02-13T20:18:32.263 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:18:32.274 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAYh49pNHg3EBAAoxTGHI/tU/u/fTM4/V/pag== 2026-02-13T20:18:32.274 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAYh49pNHg3EBAAoxTGHI/tU/u/fTM4/V/pag=="}' 2026-02-13T20:18:32.274 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0b3fb1d9-4d7d-48ef-b76b-dd8a2a7fac54 -i td/ec-error-rollforward/3/new.json 2026-02-13T20:18:32.482 INFO:tasks.workunit.client.0.trial030.stdout:3 2026-02-13T20:18:32.491 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/3/new.json 2026-02-13T20:18:32.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=32d6b623-71b2-465b-b107-b7507cb4b765 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75350/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAYh49pNHg3EBAAoxTGHI/tU/u/fTM4/V/pag== --osd-uuid 0b3fb1d9-4d7d-48ef-b76b-dd8a2a7fac54 2026-02-13T20:18:32.507 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:32.502+0000 7fa38bd96a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:32.509 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:32.502+0000 7fa38bd96a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:32.510 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:32.502+0000 7fa38bd96a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:32.511 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:32.506+0000 7fa38bd96a40 -1 bdev(0x561be340a400 td/ec-error-rollforward/3/block) open stat got: (1) Operation not permitted 2026-02-13T20:18:32.511 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:32.506+0000 7fa38bd96a40 -1 bluestore(td/ec-error-rollforward/3) _read_fsid unparsable uuid 2026-02-13T20:18:33.189 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/3/keyring 2026-02-13T20:18:33.190 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:18:33.191 INFO:tasks.workunit.client.0.trial030.stdout:adding osd3 key to auth repository 2026-02-13T20:18:33.191 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-13T20:18:33.191 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:18:33.479 INFO:tasks.workunit.client.0.trial030.stdout:start osd.3 2026-02-13T20:18:33.480 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-13T20:18:33.480 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=32d6b623-71b2-465b-b107-b7507cb4b765 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75350/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:18:33.480 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:18:33.481 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:18:33.481 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:18:33.501 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:33.494+0000 7f3a92313a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:33.502 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:33.498+0000 7f3a92313a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:33.503 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:33.498+0000 7f3a92313a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:33.699 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-13T20:18:33.699 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:18:33.699 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T20:18:33.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:18:33.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:18:33.700 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:18:33.701 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:33.701 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:18:33.701 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:33.701 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T20:18:33.907 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:18:33.915 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:33.910+0000 7f3a92313a40 -1 Falling back to public interface 2026-02-13T20:18:34.527 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:34.522+0000 7f3a92313a40 -1 osd.3 0 log_to_monitors true 2026-02-13T20:18:34.909 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:18:34.910 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:34.910 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:18:34.910 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:18:34.911 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:34.911 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T20:18:35.115 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:18:36.117 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:18:36.117 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:36.117 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T20:18:36.117 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:18:36.118 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:36.118 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T20:18:36.324 INFO:tasks.workunit.client.0.trial030.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1664610213,v1:127.0.0.1:6827/1664610213] [v2:127.0.0.1:6828/1664610213,v1:127.0.0.1:6829/1664610213] exists,up 0b3fb1d9-4d7d-48ef-b76b-dd8a2a7fac54 2026-02-13T20:18:36.325 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:18:36.325 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:18:36.325 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:18:36.326 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:35: TEST_ec_error_rollforward: ceph osd erasure-code-profile set ec-profile m=2 k=2 crush-failure-domain=osd 2026-02-13T20:18:36.581 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:36: TEST_ec_error_rollforward: ceph osd pool create ec 1 1 erasure ec-profile 2026-02-13T20:18:36.949 INFO:tasks.workunit.client.0.trial030.stderr:pool 'ec' already exists 2026-02-13T20:18:36.958 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:38: TEST_ec_error_rollforward: rados -p ec put foo /etc/passwd 2026-02-13T20:18:37.790 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: cat td/ec-error-rollforward/osd.2.pid 2026-02-13T20:18:37.791 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: kill -STOP 79297 2026-02-13T20:18:37.791 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:43: TEST_ec_error_rollforward: pids=81882 2026-02-13T20:18:37.791 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:44: TEST_ec_error_rollforward: sleep 1 2026-02-13T20:18:37.792 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:42: TEST_ec_error_rollforward: rados -p ec rm foo 2026-02-13T20:18:38.792 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:46: TEST_ec_error_rollforward: pids+=' 81903' 2026-02-13T20:18:38.792 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:45: TEST_ec_error_rollforward: rados -p ec rm a 2026-02-13T20:18:38.792 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:48: TEST_ec_error_rollforward: pids+=' 81904' 2026-02-13T20:18:38.792 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:47: TEST_ec_error_rollforward: rados -p ec rm b 2026-02-13T20:18:38.792 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:50: TEST_ec_error_rollforward: pids+=' 81905' 2026-02-13T20:18:38.793 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:51: TEST_ec_error_rollforward: sleep 1 2026-02-13T20:18:38.793 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:49: TEST_ec_error_rollforward: rados -p ec rm c 2026-02-13T20:18:39.794 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:54: TEST_ec_error_rollforward: kill_daemons td/ec-error-rollforward KILL osd 2026-02-13T20:18:39.795 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:18:39.795 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:18:39.796 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:18:39.796 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:18:39.796 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:18:39.906 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:18:39.906 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:55: TEST_ec_error_rollforward: kill 81882 81903 81904 81905 2026-02-13T20:18:39.906 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:56: TEST_ec_error_rollforward: wait 2026-02-13T20:18:39.909 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:58: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 0 2026-02-13T20:18:39.909 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-13T20:18:39.910 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T20:18:39.910 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-13T20:18:39.910 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T20:18:39.910 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/0 2026-02-13T20:18:39.910 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=32d6b623-71b2-465b-b107-b7507cb4b765 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-13T20:18:39.910 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:18:39.910 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:18:39.910 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:18:39.910 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2026-02-13T20:18:39.910 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2026-02-13T20:18:39.911 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T20:18:39.911 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T20:18:39.911 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-13T20:18:39.911 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T20:18:39.911 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:18:39.911 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:18:39.911 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:18:39.911 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:39.911 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75350 2026-02-13T20:18:39.911 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.75350/$cluster-$name.asok' 2026-02-13T20:18:39.911 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.75350/$cluster-$name.asok' 2026-02-13T20:18:39.911 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:18:39.911 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-13T20:18:39.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-13T20:18:39.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:18:39.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:18:39.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:18:39.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:18:39.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T20:18:39.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T20:18:39.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/0 2026-02-13T20:18:39.913 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-13T20:18:39.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-13T20:18:39.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=32d6b623-71b2-465b-b107-b7507cb4b765 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75350/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:18:39.914 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/0/whoami 2026-02-13T20:18:39.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-13T20:18:39.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T20:18:39.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T20:18:39.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T20:18:39.926 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:39.918+0000 7f4929d03a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:39.927 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:39.922+0000 7f4929d03a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:39.928 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:39.922+0000 7f4929d03a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:40.130 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-13T20:18:40.130 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:18:40.130 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T20:18:40.130 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:18:40.130 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:18:40.130 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:40.131 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:18:40.131 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:18:40.132 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:40.132 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:18:40.340 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2142927957,v1:127.0.0.1:6801/2142927957] [v2:127.0.0.1:6802/2142927957,v1:127.0.0.1:6803/2142927957] exists,up eed92632-1b86-4997-adc2-8304fba3b065 2026-02-13T20:18:40.343 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:18:40.343 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:18:40.343 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:18:40.343 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:59: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 1 2026-02-13T20:18:40.344 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-13T20:18:40.344 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T20:18:40.344 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T20:18:40.344 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T20:18:40.344 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/1 2026-02-13T20:18:40.344 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=32d6b623-71b2-465b-b107-b7507cb4b765 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-13T20:18:40.344 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:18:40.344 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:18:40.344 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:18:40.344 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2026-02-13T20:18:40.344 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2026-02-13T20:18:40.344 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T20:18:40.344 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T20:18:40.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-13T20:18:40.345 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T20:18:40.345 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:18:40.345 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:18:40.345 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:18:40.345 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:40.345 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75350 2026-02-13T20:18:40.345 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.75350/$cluster-$name.asok' 2026-02-13T20:18:40.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.75350/$cluster-$name.asok' 2026-02-13T20:18:40.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:18:40.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-13T20:18:40.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-13T20:18:40.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:18:40.346 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:18:40.346 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:18:40.346 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:18:40.346 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T20:18:40.346 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T20:18:40.346 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/1 2026-02-13T20:18:40.346 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-13T20:18:40.347 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T20:18:40.347 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=32d6b623-71b2-465b-b107-b7507cb4b765 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75350/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:18:40.348 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/1/whoami 2026-02-13T20:18:40.348 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T20:18:40.348 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T20:18:40.348 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T20:18:40.348 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T20:18:40.348 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:40.342+0000 7f4929d03a40 -1 Falling back to public interface 2026-02-13T20:18:40.361 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:40.354+0000 7f17d6e02a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:40.362 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:40.358+0000 7f17d6e02a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:40.363 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:40.358+0000 7f17d6e02a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:40.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-13T20:18:40.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:18:40.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T20:18:40.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:18:40.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:18:40.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:40.564 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:18:40.565 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:18:40.565 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:40.565 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:18:40.775 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 9 up_thru 22 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/760897442,v1:127.0.0.1:6811/760897442] [v2:127.0.0.1:6812/760897442,v1:127.0.0.1:6813/760897442] exists,up f00dfd47-2e38-4ad5-b26b-d225df701824 2026-02-13T20:18:40.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:18:40.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:18:40.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:18:40.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:60: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 2 2026-02-13T20:18:40.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-13T20:18:40.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T20:18:40.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T20:18:40.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T20:18:40.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/2 2026-02-13T20:18:40.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=32d6b623-71b2-465b-b107-b7507cb4b765 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-13T20:18:40.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:18:40.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:18:40.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:18:40.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2026-02-13T20:18:40.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2026-02-13T20:18:40.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T20:18:40.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T20:18:40.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-13T20:18:40.776 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T20:18:40.776 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:18:40.777 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:18:40.777 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:18:40.777 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:40.777 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75350 2026-02-13T20:18:40.777 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.75350/$cluster-$name.asok' 2026-02-13T20:18:40.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.75350/$cluster-$name.asok' 2026-02-13T20:18:40.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:18:40.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-13T20:18:40.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-13T20:18:40.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:18:40.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:18:40.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:18:40.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:18:40.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T20:18:40.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T20:18:40.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/2 2026-02-13T20:18:40.778 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-13T20:18:40.778 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T20:18:40.778 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=32d6b623-71b2-465b-b107-b7507cb4b765 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75350/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:18:40.778 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/2/whoami 2026-02-13T20:18:40.780 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T20:18:40.780 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T20:18:40.780 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T20:18:40.780 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T20:18:40.795 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:40.790+0000 7fa315a42a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:40.797 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:40.790+0000 7fa315a42a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:40.797 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:40.790+0000 7fa315a42a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:40.803 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:40.798+0000 7f17d6e02a40 -1 Falling back to public interface 2026-02-13T20:18:40.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T20:18:40.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:18:40.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T20:18:40.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:18:40.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:18:40.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:40.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:18:40.992 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:18:40.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:40.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:18:41.187 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:41.182+0000 7fa315a42a40 -1 Falling back to public interface 2026-02-13T20:18:41.210 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/4083582923,v1:127.0.0.1:6819/4083582923] [v2:127.0.0.1:6820/4083582923,v1:127.0.0.1:6821/4083582923] exists,up 0c798e0c-6d16-4d55-b213-0d7f32766055 2026-02-13T20:18:41.213 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:18:41.214 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:18:41.214 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:18:41.214 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:61: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 3 2026-02-13T20:18:41.214 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-13T20:18:41.214 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T20:18:41.214 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-13T20:18:41.214 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T20:18:41.214 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/3 2026-02-13T20:18:41.214 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=32d6b623-71b2-465b-b107-b7507cb4b765 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-13T20:18:41.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:18:41.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:18:41.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:18:41.215 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:41.206+0000 7f4929d03a40 -1 osd.0 24 log_to_monitors true 2026-02-13T20:18:41.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2026-02-13T20:18:41.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2026-02-13T20:18:41.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T20:18:41.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T20:18:41.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-13T20:18:41.215 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T20:18:41.215 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:18:41.216 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:18:41.216 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:18:41.216 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:41.216 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75350 2026-02-13T20:18:41.216 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.75350/$cluster-$name.asok' 2026-02-13T20:18:41.216 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.75350/$cluster-$name.asok' 2026-02-13T20:18:41.216 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:18:41.216 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-13T20:18:41.216 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-13T20:18:41.216 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:18:41.216 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:18:41.217 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:18:41.217 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:18:41.217 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T20:18:41.217 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T20:18:41.217 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/3 2026-02-13T20:18:41.217 INFO:tasks.workunit.client.0.trial030.stdout:start osd.3 2026-02-13T20:18:41.218 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-13T20:18:41.219 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=32d6b623-71b2-465b-b107-b7507cb4b765 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75350/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:18:41.219 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/3/whoami 2026-02-13T20:18:41.219 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-13T20:18:41.219 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T20:18:41.219 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T20:18:41.219 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T20:18:41.228 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:41.222+0000 7fdc9c29ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:41.229 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:41.222+0000 7fdc9c29ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:41.230 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:41.222+0000 7fdc9c29ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:41.434 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-13T20:18:41.434 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:18:41.435 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T20:18:41.435 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:18:41.435 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:18:41.435 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:41.435 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:18:41.436 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:18:41.436 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:41.436 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T20:18:41.630 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:41.626+0000 7f17d6e02a40 -1 osd.1 24 log_to_monitors true 2026-02-13T20:18:41.650 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:18:41.676 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:41.670+0000 7fdc9c29ca40 -1 Falling back to public interface 2026-02-13T20:18:42.054 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:42.050+0000 7fa315a42a40 -1 osd.2 23 log_to_monitors true 2026-02-13T20:18:42.450 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:42.446+0000 7fdc9c29ca40 -1 osd.3 24 log_to_monitors true 2026-02-13T20:18:42.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:18:42.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:42.651 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:18:42.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:18:42.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:42.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T20:18:42.869 INFO:tasks.workunit.client.0.trial030.stdout:osd.3 up in weight 1 up_from 38 up_thru 0 down_at 28 last_clean_interval [19,24) [v2:127.0.0.1:6826/960423879,v1:127.0.0.1:6827/960423879] [v2:127.0.0.1:6828/960423879,v1:127.0.0.1:6829/960423879] exists,up 0b3fb1d9-4d7d-48ef-b76b-dd8a2a7fac54 2026-02-13T20:18:42.871 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:18:42.871 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:18:42.871 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:18:42.871 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:63: TEST_ec_error_rollforward: wait_for_clean 2026-02-13T20:18:42.871 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T20:18:42.871 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T20:18:42.871 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T20:18:42.872 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T20:18:42.872 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T20:18:42.872 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T20:18:42.872 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T20:18:42.872 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T20:18:42.872 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T20:18:42.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T20:18:42.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T20:18:42.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T20:18:42.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T20:18:42.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T20:18:42.969 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T20:18:43.182 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T20:18:43.182 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-13T20:18:43.182 INFO:tasks.workunit.client.0.trial030.stderr:2 2026-02-13T20:18:43.182 INFO:tasks.workunit.client.0.trial030.stderr:3' 2026-02-13T20:18:43.182 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T20:18:43.183 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:18:43.183 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-13T20:18:43.261 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116995 2026-02-13T20:18:43.261 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116995 2026-02-13T20:18:43.262 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-115964116995' 2026-02-13T20:18:43.262 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:18:43.262 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-13T20:18:43.337 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986179 2026-02-13T20:18:43.337 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986179 2026-02-13T20:18:43.337 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-115964116995 1-133143986179' 2026-02-13T20:18:43.337 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:18:43.337 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-13T20:18:43.419 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855363 2026-02-13T20:18:43.419 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855363 2026-02-13T20:18:43.419 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-115964116995 1-133143986179 2-150323855363' 2026-02-13T20:18:43.419 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T20:18:43.420 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-13T20:18:43.497 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757251 2026-02-13T20:18:43.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757251 2026-02-13T20:18:43.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-115964116995 1-133143986179 2-150323855363 3-163208757251' 2026-02-13T20:18:43.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:18:43.499 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-115964116995 2026-02-13T20:18:43.499 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:18:43.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-13T20:18:43.499 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-115964116995 2026-02-13T20:18:43.500 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:18:43.501 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=115964116995 2026-02-13T20:18:43.501 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 115964116995' 2026-02-13T20:18:43.501 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 115964116995 2026-02-13T20:18:43.501 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:18:43.722 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 115964116995 2026-02-13T20:18:43.722 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-13T20:18:44.723 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T20:18:44.724 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T20:18:44.934 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 115964116995 -lt 115964116995 2026-02-13T20:18:44.934 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:18:44.935 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-133143986179 2026-02-13T20:18:44.935 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:18:44.936 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-13T20:18:44.936 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-133143986179 2026-02-13T20:18:44.937 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:18:44.938 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986179 2026-02-13T20:18:44.938 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 133143986179 2026-02-13T20:18:44.939 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 133143986179' 2026-02-13T20:18:44.939 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T20:18:45.161 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986179 -lt 133143986179 2026-02-13T20:18:45.161 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:18:45.161 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-150323855363 2026-02-13T20:18:45.162 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:18:45.163 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-13T20:18:45.163 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-150323855363 2026-02-13T20:18:45.163 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:18:45.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855363 2026-02-13T20:18:45.165 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 150323855363 2026-02-13T20:18:45.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 150323855363' 2026-02-13T20:18:45.165 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T20:18:45.390 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855363 -lt 150323855363 2026-02-13T20:18:45.390 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-13T20:18:45.391 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-163208757251 2026-02-13T20:18:45.391 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-13T20:18:45.392 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-13T20:18:45.393 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-163208757251 2026-02-13T20:18:45.393 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-13T20:18:45.394 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757251 2026-02-13T20:18:45.394 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 163208757251' 2026-02-13T20:18:45.395 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.3 seq 163208757251 2026-02-13T20:18:45.395 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T20:18:45.619 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757251 -lt 163208757251 2026-02-13T20:18:45.620 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T20:18:45.620 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:18:45.620 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:18:45.901 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T20:18:45.901 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T20:18:45.902 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T20:18:45.902 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T20:18:45.902 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T20:18:45.902 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T20:18:45.902 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T20:18:45.902 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T20:18:46.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-13T20:18:46.104 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T20:18:46.105 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T20:18:46.105 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T20:18:46.394 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-13T20:18:46.394 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T20:18:46.394 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T20:18:46.394 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:22: run: teardown td/ec-error-rollforward 2026-02-13T20:18:46.394 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-13T20:18:46.394 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T20:18:46.394 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-13T20:18:46.394 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:18:46.394 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:18:46.394 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:18:46.394 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:18:46.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:18:46.504 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:18:46.504 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T20:18:46.505 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T20:18:46.506 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T20:18:46.507 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T20:18:46.507 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T20:18:46.507 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T20:18:46.509 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:18:46.509 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T20:18:46.509 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T20:18:46.509 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:18:46.510 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:18:46.511 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T20:18:46.511 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-13T20:18:46.525 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T20:18:46.525 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:46.525 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75350 2026-02-13T20:18:46.525 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.75350 2026-02-13T20:18:46.527 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T20:18:46.527 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T20:18:46.527 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-13T20:18:46.527 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/ec-error-rollforward 0 2026-02-13T20:18:46.527 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-13T20:18:46.527 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-13T20:18:46.527 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-13T20:18:46.527 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:18:46.527 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:18:46.527 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:18:46.527 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:18:46.527 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:18:46.530 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:18:46.530 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T20:18:46.530 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T20:18:46.531 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T20:18:46.532 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T20:18:46.532 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T20:18:46.532 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T20:18:46.533 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:18:46.533 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T20:18:46.533 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T20:18:46.533 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:18:46.534 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:18:46.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-13T20:18:46.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-13T20:18:46.536 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T20:18:46.536 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:46.536 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75350 2026-02-13T20:18:46.536 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.75350 2026-02-13T20:18:46.538 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T20:18:46.538 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T20:18:46.538 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-13T20:18:46.540 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-13T20:18:46.540 DEBUG:teuthology.orchestra.run.trial030:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-13T20:18:46.590 INFO:tasks.workunit:Running workunit osd/osd-bench.sh... 2026-02-13T20:18:46.591 DEBUG:teuthology.orchestra.run.trial030:workunit test osd/osd-bench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=afefaa40503a4bf024e96f97dd7f852b75f00ad6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh 2026-02-13T20:18:46.642 INFO:tasks.workunit.client.0.trial030.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-13T20:18:46.648 INFO:tasks.workunit.client.0.trial030.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-13T20:18:46.648 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-13T20:18:46.648 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-13T20:18:46.648 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-13T20:18:46.648 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-13T20:18:46.648 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-13T20:18:46.648 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-13T20:18:46.648 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-13T20:18:46.648 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-13T20:18:46.648 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-bench 2026-02-13T20:18:46.649 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:22: run: local dir=td/osd-bench 2026-02-13T20:18:46.649 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:23: run: shift 2026-02-13T20:18:46.649 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: export CEPH_MON=127.0.0.1:7106 2026-02-13T20:18:46.649 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: CEPH_MON=127.0.0.1:7106 2026-02-13T20:18:46.649 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:26: run: export CEPH_ARGS 2026-02-13T20:18:46.649 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: uuidgen 2026-02-13T20:18:46.650 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: CEPH_ARGS+='--fsid=30bf5e5c-2d90-457f-a0f7-99c3baa80e96 --auth-supported=none ' 2026-02-13T20:18:46.650 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7106 ' 2026-02-13T20:18:46.650 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:29: run: CEPH_ARGS+='--debug-bluestore 20 ' 2026-02-13T20:18:46.650 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: set 2026-02-13T20:18:46.650 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-13T20:18:46.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: local funcs=TEST_bench 2026-02-13T20:18:46.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:32: run: for func in $funcs 2026-02-13T20:18:46.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:33: run: setup td/osd-bench 2026-02-13T20:18:46.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bench 2026-02-13T20:18:46.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bench 2026-02-13T20:18:46.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-13T20:18:46.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T20:18:46.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-13T20:18:46.652 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:18:46.652 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:18:46.653 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:18:46.653 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:18:46.653 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:18:46.653 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:18:46.653 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T20:18:46.654 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T20:18:46.655 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T20:18:46.656 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T20:18:46.656 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T20:18:46.656 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T20:18:46.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:18:46.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T20:18:46.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T20:18:46.659 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:18:46.659 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:18:46.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T20:18:46.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-13T20:18:46.661 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T20:18:46.662 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:46.662 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.84545 2026-02-13T20:18:46.662 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.84545 2026-02-13T20:18:46.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T20:18:46.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T20:18:46.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bench 2026-02-13T20:18:46.664 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T20:18:46.664 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:46.665 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.84545 2026-02-13T20:18:46.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.84545 2026-02-13T20:18:46.666 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T20:18:46.667 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-13T20:18:46.667 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-13T20:18:46.667 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T20:18:46.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bench 1' TERM HUP INT 2026-02-13T20:18:46.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:34: run: TEST_bench td/osd-bench 2026-02-13T20:18:46.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:40: TEST_bench: local dir=td/osd-bench 2026-02-13T20:18:46.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:42: TEST_bench: run_mon td/osd-bench a 2026-02-13T20:18:46.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bench 2026-02-13T20:18:46.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T20:18:46.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T20:18:46.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T20:18:46.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bench/a 2026-02-13T20:18:46.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bench/a --run-dir=td/osd-bench 2026-02-13T20:18:46.691 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T20:18:46.691 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:18:46.691 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:18:46.692 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:18:46.692 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:46.692 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.84545 2026-02-13T20:18:46.692 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.84545/$cluster-$name.asok' 2026-02-13T20:18:46.693 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bench/a '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.84545/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bench/log --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T20:18:46.721 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T20:18:46.722 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T20:18:46.722 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T20:18:46.722 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T20:18:46.722 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T20:18:46.722 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T20:18:46.724 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T20:18:46.724 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T20:18:46.724 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T20:18:46.724 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:18:46.724 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:46.724 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.84545 2026-02-13T20:18:46.724 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.84545/ceph-mon.a.asok 2026-02-13T20:18:46.724 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T20:18:46.724 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.84545/ceph-mon.a.asok config get fsid 2026-02-13T20:18:46.781 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T20:18:46.781 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T20:18:46.781 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T20:18:46.782 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T20:18:46.782 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T20:18:46.782 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T20:18:46.782 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T20:18:46.782 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T20:18:46.782 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:18:46.782 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:46.782 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.84545 2026-02-13T20:18:46.782 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.84545/ceph-mon.a.asok 2026-02-13T20:18:46.783 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T20:18:46.783 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.84545/ceph-mon.a.asok config get mon_host 2026-02-13T20:18:46.838 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:43: TEST_bench: run_mgr td/osd-bench x 2026-02-13T20:18:46.838 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bench 2026-02-13T20:18:46.838 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T20:18:46.838 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T20:18:46.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T20:18:46.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bench/x 2026-02-13T20:18:46.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T20:18:46.949 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T20:18:46.949 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:18:46.949 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:18:46.950 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:18:46.950 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:46.950 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.84545 2026-02-13T20:18:46.950 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.84545/$cluster-$name.asok' 2026-02-13T20:18:46.950 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T20:18:46.951 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bench/x '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.84545/$cluster-$name.asok' --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T20:18:46.967 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:44: TEST_bench: run_osd td/osd-bench 0 2026-02-13T20:18:46.967 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bench 2026-02-13T20:18:46.967 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:18:46.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T20:18:46.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:18:46.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bench/0 2026-02-13T20:18:46.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=30bf5e5c-2d90-457f-a0f7-99c3baa80e96 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 ' 2026-02-13T20:18:46.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:18:46.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:18:46.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:18:46.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bench/0' 2026-02-13T20:18:46.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bench/0/journal' 2026-02-13T20:18:46.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:18:46.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:18:46.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bench' 2026-02-13T20:18:46.968 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:18:46.968 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:18:46.968 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:18:46.969 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:18:46.969 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:46.969 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.84545 2026-02-13T20:18:46.969 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.84545/$cluster-$name.asok' 2026-02-13T20:18:46.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.84545/$cluster-$name.asok' 2026-02-13T20:18:46.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:18:46.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:18:46.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:18:46.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bench/$name.log' 2026-02-13T20:18:46.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bench/$name.pid' 2026-02-13T20:18:46.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:18:46.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:18:46.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:18:46.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:18:46.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:18:46.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:18:46.971 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bench/0 2026-02-13T20:18:46.971 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:18:46.971 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6132ea37-37c1-4d8d-a061-b66cb7917ae2 2026-02-13T20:18:46.972 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 6132ea37-37c1-4d8d-a061-b66cb7917ae2' 2026-02-13T20:18:46.972 INFO:tasks.workunit.client.0.trial030.stdout:add osd0 6132ea37-37c1-4d8d-a061-b66cb7917ae2 2026-02-13T20:18:46.972 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:18:46.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAmh49p0kVzOhAAwa6stih5n7EhB1KC8fR5Fw== 2026-02-13T20:18:46.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAmh49p0kVzOhAAwa6stih5n7EhB1KC8fR5Fw=="}' 2026-02-13T20:18:46.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6132ea37-37c1-4d8d-a061-b66cb7917ae2 -i td/osd-bench/0/new.json 2026-02-13T20:18:47.092 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:18:47.099 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bench/0/new.json 2026-02-13T20:18:47.101 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=30bf5e5c-2d90-457f-a0f7-99c3baa80e96 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.84545/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAmh49p0kVzOhAAwa6stih5n7EhB1KC8fR5Fw== --osd-uuid 6132ea37-37c1-4d8d-a061-b66cb7917ae2 2026-02-13T20:18:47.116 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:47.110+0000 7fd8ba017a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:47.117 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:47.110+0000 7fd8ba017a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:47.118 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:47.114+0000 7fd8ba017a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:47.119 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:47.114+0000 7fd8ba017a40 -1 bdev(0x55f16fc28400 td/osd-bench/0/block) open stat got: (1) Operation not permitted 2026-02-13T20:18:47.119 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:47.114+0000 7fd8ba017a40 -1 bluestore(td/osd-bench/0) _read_fsid unparsable uuid 2026-02-13T20:18:47.852 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bench/0/keyring 2026-02-13T20:18:47.852 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:18:47.853 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T20:18:47.854 INFO:tasks.workunit.client.0.trial030.stdout:adding osd0 key to auth repository 2026-02-13T20:18:47.854 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bench/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:18:47.975 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-13T20:18:47.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T20:18:47.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=30bf5e5c-2d90-457f-a0f7-99c3baa80e96 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.84545/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:18:47.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:18:47.976 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:18:47.976 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:18:47.998 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:47.994+0000 7f1ec8d11a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:48.000 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:47.994+0000 7f1ec8d11a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:48.002 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:47.994+0000 7f1ec8d11a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:48.087 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T20:18:48.087 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:18:48.087 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T20:18:48.087 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:18:48.087 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:18:48.087 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:48.087 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:18:48.087 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:18:48.087 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:48.087 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:18:48.196 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:18:48.404 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:48.397+0000 7f1ec8d11a40 -1 Falling back to public interface 2026-02-13T20:18:49.056 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:49.049+0000 7f1ec8d11a40 -1 osd.0 0 log_to_monitors true 2026-02-13T20:18:49.197 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:18:49.197 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:49.197 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:18:49.198 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:18:49.198 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:49.198 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:18:49.311 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:18:50.312 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:18:50.312 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:50.312 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:18:50.312 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T20:18:50.312 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:50.312 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:18:50.522 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/567841571,v1:127.0.0.1:6801/567841571] [v2:127.0.0.1:6802/567841571,v1:127.0.0.1:6803/567841571] exists,up 6132ea37-37c1-4d8d-a061-b66cb7917ae2 2026-02-13T20:18:50.522 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:18:50.522 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:18:50.522 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:18:50.522 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: CEPH_ARGS= 2026-02-13T20:18:50.522 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: ceph-conf --show-config-value osd_bench_small_size_max_iops 2026-02-13T20:18:50.533 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: local osd_bench_small_size_max_iops=100 2026-02-13T20:18:50.533 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: CEPH_ARGS= 2026-02-13T20:18:50.533 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: ceph-conf --show-config-value osd_bench_large_size_max_throughput 2026-02-13T20:18:50.548 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: local osd_bench_large_size_max_throughput=104857600 2026-02-13T20:18:50.548 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: CEPH_ARGS= 2026-02-13T20:18:50.548 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: ceph-conf --show-config-value osd_bench_max_block_size 2026-02-13T20:18:50.561 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: local osd_bench_max_block_size=67108864 2026-02-13T20:18:50.561 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: CEPH_ARGS= 2026-02-13T20:18:50.561 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: ceph-conf --show-config-value osd_bench_duration 2026-02-13T20:18:50.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: local osd_bench_duration=30 2026-02-13T20:18:50.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:58: TEST_bench: expect_failure td/osd-bench osd_bench_max_block_size ceph tell osd.0 bench 1024 67108865 2026-02-13T20:18:50.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-13T20:18:50.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-13T20:18:50.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=osd_bench_max_block_size 2026-02-13T20:18:50.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-13T20:18:50.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-13T20:18:50.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 1024 67108865 2026-02-13T20:18:50.664 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-13T20:18:50.664 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-13T20:18:50.664 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet osd_bench_max_block_size td/osd-bench/out 2026-02-13T20:18:50.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-13T20:18:50.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:64: TEST_bench: local bsize=1024 2026-02-13T20:18:50.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:65: TEST_bench: local max_count=3072000 2026-02-13T20:18:50.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:66: TEST_bench: expect_failure td/osd-bench bench_small_size_max_iops ceph tell osd.0 bench 3072001 1024 2026-02-13T20:18:50.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-13T20:18:50.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-13T20:18:50.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=bench_small_size_max_iops 2026-02-13T20:18:50.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-13T20:18:50.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-13T20:18:50.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 3072001 1024 2026-02-13T20:18:50.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-13T20:18:50.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-13T20:18:50.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet bench_small_size_max_iops td/osd-bench/out 2026-02-13T20:18:50.738 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-13T20:18:50.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:72: TEST_bench: local bsize=1048577 2026-02-13T20:18:50.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:73: TEST_bench: local max_count=3145728000 2026-02-13T20:18:50.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:74: TEST_bench: expect_failure td/osd-bench osd_bench_large_size_max_throughput ceph tell osd.0 bench 3145728001 1048577 2026-02-13T20:18:50.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-13T20:18:50.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-13T20:18:50.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=osd_bench_large_size_max_throughput 2026-02-13T20:18:50.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-13T20:18:50.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-13T20:18:50.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 3145728001 1048577 2026-02-13T20:18:50.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-13T20:18:50.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-13T20:18:50.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet osd_bench_large_size_max_throughput td/osd-bench/out 2026-02-13T20:18:50.804 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-13T20:18:50.804 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:80: TEST_bench: ceph tell osd.0 bench 2026-02-13T20:18:52.449 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-13T20:18:52.450 INFO:tasks.workunit.client.0.trial030.stdout: "bytes_written": 1073741824, 2026-02-13T20:18:52.450 INFO:tasks.workunit.client.0.trial030.stdout: "blocksize": 4194304, 2026-02-13T20:18:52.450 INFO:tasks.workunit.client.0.trial030.stdout: "elapsed_sec": 0.72021638200000004, 2026-02-13T20:18:52.450 INFO:tasks.workunit.client.0.trial030.stdout: "bytes_per_sec": 1490860039.8928442, 2026-02-13T20:18:52.450 INFO:tasks.workunit.client.0.trial030.stdout: "iops": 355.4487323505507 2026-02-13T20:18:52.450 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-13T20:18:52.463 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:84: TEST_bench: ceph tell osd.0 bench 10 14456 4444 3 2026-02-13T20:18:52.534 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-13T20:18:52.535 INFO:tasks.workunit.client.0.trial030.stdout: "bytes_written": 10, 2026-02-13T20:18:52.535 INFO:tasks.workunit.client.0.trial030.stdout: "blocksize": 14456, 2026-02-13T20:18:52.535 INFO:tasks.workunit.client.0.trial030.stdout: "elapsed_sec": 0.000315192, 2026-02-13T20:18:52.535 INFO:tasks.workunit.client.0.trial030.stdout: "bytes_per_sec": 31726.693570902815, 2026-02-13T20:18:52.535 INFO:tasks.workunit.client.0.trial030.stdout: "iops": 2.1947076349545389 2026-02-13T20:18:52.535 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-13T20:18:52.541 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:90: TEST_bench: ceph tell osd.0 bench 1 14456 2026-02-13T20:18:52.621 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-13T20:18:52.621 INFO:tasks.workunit.client.0.trial030.stdout: "bytes_written": 1, 2026-02-13T20:18:52.621 INFO:tasks.workunit.client.0.trial030.stdout: "blocksize": 14456, 2026-02-13T20:18:52.621 INFO:tasks.workunit.client.0.trial030.stdout: "elapsed_sec": 0.000232399, 2026-02-13T20:18:52.621 INFO:tasks.workunit.client.0.trial030.stdout: "bytes_per_sec": 4302.9445049247197, 2026-02-13T20:18:52.621 INFO:tasks.workunit.client.0.trial030.stdout: "iops": 0.29765803160796345 2026-02-13T20:18:52.622 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-13T20:18:52.629 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:35: run: teardown td/osd-bench 2026-02-13T20:18:52.629 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-13T20:18:52.629 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T20:18:52.629 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-13T20:18:52.630 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:18:52.630 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:18:52.630 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:18:52.630 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:18:52.630 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:18:52.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:18:52.738 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T20:18:52.738 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T20:18:52.739 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T20:18:52.740 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T20:18:52.740 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T20:18:52.740 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T20:18:52.741 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:18:52.741 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T20:18:52.742 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T20:18:52.742 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:18:52.743 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:18:52.744 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T20:18:52.744 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-13T20:18:52.778 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T20:18:52.778 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:52.779 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.84545 2026-02-13T20:18:52.779 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.84545 2026-02-13T20:18:52.780 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T20:18:52.781 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T20:18:52.781 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-13T20:18:52.781 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-bench 0 2026-02-13T20:18:52.781 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-13T20:18:52.781 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-13T20:18:52.781 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-13T20:18:52.781 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:18:52.781 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:18:52.781 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:18:52.781 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:18:52.781 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:18:52.782 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:18:52.783 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T20:18:52.783 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T20:18:52.784 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T20:18:52.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T20:18:52.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T20:18:52.785 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T20:18:52.786 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:18:52.786 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T20:18:52.786 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T20:18:52.786 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:18:52.787 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:18:52.788 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-13T20:18:52.788 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-13T20:18:52.790 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T20:18:52.790 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:52.790 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.84545 2026-02-13T20:18:52.790 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.84545 2026-02-13T20:18:52.791 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T20:18:52.791 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T20:18:52.791 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-13T20:18:52.792 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-13T20:18:52.792 DEBUG:teuthology.orchestra.run.trial030:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-13T20:18:52.846 INFO:tasks.workunit:Running workunit osd/osd-bluefs-volume-ops.sh... 2026-02-13T20:18:52.847 DEBUG:teuthology.orchestra.run.trial030:workunit test osd/osd-bluefs-volume-ops.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=afefaa40503a4bf024e96f97dd7f852b75f00ad6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh 2026-02-13T20:18:52.898 INFO:tasks.workunit.client.0.trial030.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-13T20:18:52.903 INFO:tasks.workunit.client.0.trial030.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-13T20:18:52.903 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-13T20:18:52.904 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-13T20:18:52.904 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-13T20:18:52.904 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-13T20:18:52.904 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-13T20:18:52.904 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-13T20:18:52.904 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-13T20:18:52.904 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-13T20:18:52.904 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-bluefs-volume-ops 2026-02-13T20:18:52.904 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:8: run: local dir=td/osd-bluefs-volume-ops 2026-02-13T20:18:52.904 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:9: run: shift 2026-02-13T20:18:52.904 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: set 2026-02-13T20:18:52.904 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-13T20:18:52.906 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: local 'funcs=TEST_bluestore 2026-02-13T20:18:52.907 INFO:tasks.workunit.client.0.trial030.stderr:TEST_bluestore2 2026-02-13T20:18:52.907 INFO:tasks.workunit.client.0.trial030.stderr:TEST_bluestore_expand' 2026-02-13T20:18:52.907 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-13T20:18:52.907 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-13T20:18:52.907 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-13T20:18:52.907 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-13T20:18:52.907 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-13T20:18:52.907 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T20:18:52.907 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-13T20:18:52.907 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:18:52.907 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:18:52.907 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:18:52.907 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:18:52.908 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:18:52.909 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:18:52.909 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T20:18:52.910 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T20:18:52.911 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T20:18:52.911 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T20:18:52.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T20:18:52.912 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T20:18:52.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:18:52.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T20:18:52.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T20:18:52.914 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:18:52.915 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:18:52.916 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T20:18:52.916 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-13T20:18:52.917 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T20:18:52.918 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:52.918 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86753 2026-02-13T20:18:52.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.86753 2026-02-13T20:18:52.919 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T20:18:52.919 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T20:18:52.919 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-13T20:18:52.921 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T20:18:52.921 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:52.921 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86753 2026-02-13T20:18:52.921 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.86753 2026-02-13T20:18:52.922 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T20:18:52.923 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-13T20:18:52.923 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-13T20:18:52.923 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T20:18:52.923 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-13T20:18:52.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore td/osd-bluefs-volume-ops 2026-02-13T20:18:52.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:20: TEST_bluestore: local dir=td/osd-bluefs-volume-ops 2026-02-13T20:18:52.924 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: TEST_bluestore: ulimit -n 2026-02-13T20:18:52.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: TEST_bluestore: local flimit=4096 2026-02-13T20:18:52.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:23: TEST_bluestore: '[' 4096 -lt 1536 ']' 2026-02-13T20:18:52.925 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:26: TEST_bluestore: export CEPH_MON=127.0.0.1:7146 2026-02-13T20:18:52.925 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:26: TEST_bluestore: CEPH_MON=127.0.0.1:7146 2026-02-13T20:18:52.925 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:27: TEST_bluestore: export CEPH_ARGS 2026-02-13T20:18:52.925 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:28: TEST_bluestore: uuidgen 2026-02-13T20:18:52.926 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:28: TEST_bluestore: CEPH_ARGS+='--fsid=ce57c786-d803-4303-8b97-0420bb37917f --auth-supported=none ' 2026-02-13T20:18:52.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:29: TEST_bluestore: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-13T20:18:52.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:30: TEST_bluestore: CEPH_ARGS+='--bluestore_block_size=2147483648 ' 2026-02-13T20:18:52.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:31: TEST_bluestore: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-13T20:18:52.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:32: TEST_bluestore: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-13T20:18:52.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:33: TEST_bluestore: CEPH_ARGS+='--bluestore_block_wal_size=536870912 ' 2026-02-13T20:18:52.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:34: TEST_bluestore: CEPH_ARGS+='--bluestore_block_wal_create=true ' 2026-02-13T20:18:52.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:35: TEST_bluestore: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-13T20:18:52.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:37: TEST_bluestore: CEPH_ARGS+='--bluestore_allocation_from_file=0 ' 2026-02-13T20:18:52.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:39: TEST_bluestore: run_mon td/osd-bluefs-volume-ops a 2026-02-13T20:18:52.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-13T20:18:52.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T20:18:52.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T20:18:52.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T20:18:52.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-13T20:18:52.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-13T20:18:52.949 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T20:18:52.949 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:18:52.949 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:18:52.949 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:18:52.949 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:52.949 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86753 2026-02-13T20:18:52.949 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.86753/$cluster-$name.asok' 2026-02-13T20:18:52.950 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.86753/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T20:18:52.986 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T20:18:52.988 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T20:18:52.988 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T20:18:52.988 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T20:18:52.988 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T20:18:52.988 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T20:18:52.989 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T20:18:52.989 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T20:18:52.989 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T20:18:52.990 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:18:52.990 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:52.990 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86753 2026-02-13T20:18:52.990 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.86753/ceph-mon.a.asok 2026-02-13T20:18:52.990 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T20:18:52.990 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.86753/ceph-mon.a.asok config get fsid 2026-02-13T20:18:53.044 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T20:18:53.044 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T20:18:53.045 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T20:18:53.045 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T20:18:53.045 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T20:18:53.045 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T20:18:53.045 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T20:18:53.045 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T20:18:53.046 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T20:18:53.046 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:53.046 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86753 2026-02-13T20:18:53.046 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.86753/ceph-mon.a.asok 2026-02-13T20:18:53.047 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T20:18:53.047 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.86753/ceph-mon.a.asok config get mon_host 2026-02-13T20:18:53.099 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:40: TEST_bluestore: run_mgr td/osd-bluefs-volume-ops x 2026-02-13T20:18:53.100 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-13T20:18:53.100 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T20:18:53.100 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T20:18:53.100 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T20:18:53.100 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-13T20:18:53.100 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T20:18:53.208 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T20:18:53.208 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:18:53.208 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:18:53.208 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:18:53.208 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:53.208 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86753 2026-02-13T20:18:53.208 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.86753/$cluster-$name.asok' 2026-02-13T20:18:53.209 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T20:18:53.210 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.86753/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T20:18:53.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:41: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 0 2026-02-13T20:18:53.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T20:18:53.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:18:53.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T20:18:53.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:18:53.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-13T20:18:53.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=ce57c786-d803-4303-8b97-0420bb37917f --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-13T20:18:53.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:18:53.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:18:53.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:18:53.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-13T20:18:53.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-13T20:18:53.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:18:53.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:18:53.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T20:18:53.229 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:18:53.230 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:18:53.230 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:18:53.230 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:18:53.230 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:53.230 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86753 2026-02-13T20:18:53.230 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.86753/$cluster-$name.asok' 2026-02-13T20:18:53.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.86753/$cluster-$name.asok' 2026-02-13T20:18:53.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:18:53.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:18:53.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:18:53.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T20:18:53.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T20:18:53.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:18:53.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:18:53.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:18:53.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:18:53.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:18:53.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:18:53.231 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-13T20:18:53.232 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:18:53.233 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d2b5e142-16cb-4022-a2e6-f4836f748cfe 2026-02-13T20:18:53.233 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 d2b5e142-16cb-4022-a2e6-f4836f748cfe' 2026-02-13T20:18:53.233 INFO:tasks.workunit.client.0.trial030.stdout:add osd0 d2b5e142-16cb-4022-a2e6-f4836f748cfe 2026-02-13T20:18:53.234 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:18:53.244 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAth49pV1NlDhAAFV7uG0rn299t9L1Jq52Wvw== 2026-02-13T20:18:53.244 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAth49pV1NlDhAAFV7uG0rn299t9L1Jq52Wvw=="}' 2026-02-13T20:18:53.244 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d2b5e142-16cb-4022-a2e6-f4836f748cfe -i td/osd-bluefs-volume-ops/0/new.json 2026-02-13T20:18:53.356 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:18:53.363 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-13T20:18:53.365 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=ce57c786-d803-4303-8b97-0420bb37917f --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.86753/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAth49pV1NlDhAAFV7uG0rn299t9L1Jq52Wvw== --osd-uuid d2b5e142-16cb-4022-a2e6-f4836f748cfe 2026-02-13T20:18:53.381 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:53.373+0000 7f0f3194ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:53.382 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:53.377+0000 7f0f3194ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:53.383 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:53.377+0000 7f0f3194ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:53.383 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:53.377+0000 7f0f3194ca40 -1 bdev(0x55bab3854400 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-13T20:18:53.383 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:53.377+0000 7f0f3194ca40 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-13T20:18:55.174 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-13T20:18:55.174 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:18:55.175 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T20:18:55.175 INFO:tasks.workunit.client.0.trial030.stdout:adding osd0 key to auth repository 2026-02-13T20:18:55.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:18:55.295 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-13T20:18:55.295 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T20:18:55.295 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=ce57c786-d803-4303-8b97-0420bb37917f --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.86753/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:18:55.296 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:18:55.296 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:18:55.296 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:18:55.319 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:55.313+0000 7f6134f2ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:55.321 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:55.313+0000 7f6134f2ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:55.322 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:55.317+0000 7f6134f2ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:55.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T20:18:55.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:18:55.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T20:18:55.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:18:55.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:18:55.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:55.441 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:18:55.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:18:55.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:55.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:18:55.547 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:18:55.892 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:55.885+0000 7f6134f2ea40 -1 Falling back to public interface 2026-02-13T20:18:56.548 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:18:56.548 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:56.549 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:18:56.549 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:18:56.549 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:56.549 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:18:56.761 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:18:57.023 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:57.017+0000 7f6134f2ea40 -1 osd.0 0 log_to_monitors true 2026-02-13T20:18:57.762 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:18:57.762 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:18:57.763 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:18:57.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T20:18:57.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:18:57.764 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T20:18:57.972 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2371743001,v1:127.0.0.1:6803/2371743001] [v2:127.0.0.1:6804/2371743001,v1:127.0.0.1:6805/2371743001] exists,up d2b5e142-16cb-4022-a2e6-f4836f748cfe 2026-02-13T20:18:57.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:18:57.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:18:57.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:18:57.973 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-13T20:18:57.977 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: osd_pid0=88128 2026-02-13T20:18:57.977 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:43: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 1 2026-02-13T20:18:57.977 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T20:18:57.977 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:18:57.977 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T20:18:57.977 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:18:57.977 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-13T20:18:57.978 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=ce57c786-d803-4303-8b97-0420bb37917f --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-13T20:18:57.978 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:18:57.978 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:18:57.978 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:18:57.978 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-13T20:18:57.978 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-13T20:18:57.978 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:18:57.978 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:18:57.978 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T20:18:57.978 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:18:57.978 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:18:57.979 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:18:57.979 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:18:57.979 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:18:57.979 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86753 2026-02-13T20:18:57.979 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.86753/$cluster-$name.asok' 2026-02-13T20:18:57.979 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.86753/$cluster-$name.asok' 2026-02-13T20:18:57.979 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:18:57.979 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:18:57.979 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:18:57.979 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T20:18:57.980 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T20:18:57.980 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:18:57.980 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:18:57.980 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:18:57.980 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:18:57.980 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:18:57.980 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:18:57.980 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-13T20:18:57.980 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:18:57.981 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=48d9a9b7-fe9d-4d22-b463-c949f35e55db 2026-02-13T20:18:57.981 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 48d9a9b7-fe9d-4d22-b463-c949f35e55db' 2026-02-13T20:18:57.981 INFO:tasks.workunit.client.0.trial030.stdout:add osd1 48d9a9b7-fe9d-4d22-b463-c949f35e55db 2026-02-13T20:18:57.982 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:18:57.989 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAxh49pv2HROhAA1E8+UnDRcYTjnOqiTj42+g== 2026-02-13T20:18:57.989 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAxh49pv2HROhAA1E8+UnDRcYTjnOqiTj42+g=="}' 2026-02-13T20:18:57.989 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 48d9a9b7-fe9d-4d22-b463-c949f35e55db -i td/osd-bluefs-volume-ops/1/new.json 2026-02-13T20:18:58.213 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:18:58.222 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/1/new.json 2026-02-13T20:18:58.223 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=ce57c786-d803-4303-8b97-0420bb37917f --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.86753/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAxh49pv2HROhAA1E8+UnDRcYTjnOqiTj42+g== --osd-uuid 48d9a9b7-fe9d-4d22-b463-c949f35e55db 2026-02-13T20:18:58.239 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:58.233+0000 7fb441c1ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:58.241 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:58.233+0000 7fb441c1ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:58.242 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:58.237+0000 7fb441c1ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:58.242 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:58.237+0000 7fb441c1ea40 -1 bdev(0x558a747f6400 td/osd-bluefs-volume-ops/1/block) open stat got: (1) Operation not permitted 2026-02-13T20:18:58.242 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:58.237+0000 7fb441c1ea40 -1 bluestore(td/osd-bluefs-volume-ops/1) _read_fsid unparsable uuid 2026-02-13T20:18:59.625 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/1/keyring 2026-02-13T20:18:59.626 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:18:59.627 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T20:18:59.627 INFO:tasks.workunit.client.0.trial030.stdout:adding osd1 key to auth repository 2026-02-13T20:18:59.627 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:18:59.926 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-13T20:18:59.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T20:18:59.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=ce57c786-d803-4303-8b97-0420bb37917f --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.86753/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:18:59.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:18:59.927 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:18:59.928 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:18:59.950 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:59.941+0000 7ff91f9b3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:59.952 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:59.945+0000 7ff91f9b3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:18:59.953 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:18:59.945+0000 7ff91f9b3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:19:00.163 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T20:19:00.163 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:19:00.163 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T20:19:00.163 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:19:00.163 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:19:00.163 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:19:00.164 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:19:00.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:19:00.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:19:00.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:19:00.371 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:19:00.580 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:19:00.573+0000 7ff91f9b3a40 -1 Falling back to public interface 2026-02-13T20:19:01.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:19:01.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:19:01.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:19:01.372 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:19:01.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:19:01.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:19:01.586 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:19:01.766 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:19:01.761+0000 7ff91f9b3a40 -1 osd.1 0 log_to_monitors true 2026-02-13T20:19:02.587 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:19:02.587 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:19:02.587 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:19:02.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T20:19:02.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:19:02.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T20:19:02.802 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2119386596,v1:127.0.0.1:6811/2119386596] [v2:127.0.0.1:6812/2119386596,v1:127.0.0.1:6813/2119386596] exists,up 48d9a9b7-fe9d-4d22-b463-c949f35e55db 2026-02-13T20:19:02.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:19:02.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:19:02.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:19:02.803 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-13T20:19:02.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: osd_pid1=90681 2026-02-13T20:19:02.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:45: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 2 2026-02-13T20:19:02.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T20:19:02.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:19:02.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T20:19:02.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:19:02.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-13T20:19:02.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=ce57c786-d803-4303-8b97-0420bb37917f --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-13T20:19:02.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:19:02.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:19:02.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:19:02.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-13T20:19:02.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-13T20:19:02.806 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:19:02.806 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:19:02.806 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T20:19:02.806 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:19:02.806 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:19:02.806 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:19:02.806 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:19:02.806 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:19:02.806 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86753 2026-02-13T20:19:02.806 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.86753/$cluster-$name.asok' 2026-02-13T20:19:02.807 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.86753/$cluster-$name.asok' 2026-02-13T20:19:02.807 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:19:02.807 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:19:02.807 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:19:02.807 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T20:19:02.807 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T20:19:02.807 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:19:02.807 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:19:02.807 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:19:02.807 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:19:02.807 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:19:02.807 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:19:02.807 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-13T20:19:02.808 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:19:02.809 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f7516977-77a5-4809-a1d0-6f139d4b1746 2026-02-13T20:19:02.809 INFO:tasks.workunit.client.0.trial030.stdout:add osd2 f7516977-77a5-4809-a1d0-6f139d4b1746 2026-02-13T20:19:02.809 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 f7516977-77a5-4809-a1d0-6f139d4b1746' 2026-02-13T20:19:02.810 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:19:02.821 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA2h49pUKrQMBAAPswW6isRF5gvhPMVf2koPg== 2026-02-13T20:19:02.821 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA2h49pUKrQMBAAPswW6isRF5gvhPMVf2koPg=="}' 2026-02-13T20:19:02.822 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f7516977-77a5-4809-a1d0-6f139d4b1746 -i td/osd-bluefs-volume-ops/2/new.json 2026-02-13T20:19:03.045 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:19:03.056 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/2/new.json 2026-02-13T20:19:03.057 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=ce57c786-d803-4303-8b97-0420bb37917f --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.86753/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA2h49pUKrQMBAAPswW6isRF5gvhPMVf2koPg== --osd-uuid f7516977-77a5-4809-a1d0-6f139d4b1746 2026-02-13T20:19:03.082 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:19:03.077+0000 7fdc60914a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:19:03.084 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:19:03.077+0000 7fdc60914a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:19:03.085 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:19:03.077+0000 7fdc60914a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:19:03.085 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:19:03.077+0000 7fdc60914a40 -1 bdev(0x557650948400 td/osd-bluefs-volume-ops/2/block) open stat got: (1) Operation not permitted 2026-02-13T20:19:03.085 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:19:03.077+0000 7fdc60914a40 -1 bluestore(td/osd-bluefs-volume-ops/2) _read_fsid unparsable uuid 2026-02-13T20:19:04.557 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/2/keyring 2026-02-13T20:19:04.558 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:19:04.559 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T20:19:04.559 INFO:tasks.workunit.client.0.trial030.stdout:adding osd2 key to auth repository 2026-02-13T20:19:04.559 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:19:04.849 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-13T20:19:04.849 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T20:19:04.849 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=ce57c786-d803-4303-8b97-0420bb37917f --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.86753/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:19:04.849 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:19:04.850 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:19:04.850 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:19:04.873 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:19:04.865+0000 7fdd10cc5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:19:04.874 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:19:04.869+0000 7fdd10cc5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:19:04.876 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:19:04.869+0000 7fdd10cc5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:19:05.064 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T20:19:05.064 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:19:05.064 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T20:19:05.064 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:19:05.064 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:19:05.064 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:19:05.065 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:19:05.065 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:19:05.065 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:19:05.066 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:19:05.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:19:05.396 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:19:05.389+0000 7fdd10cc5a40 -1 Falling back to public interface 2026-02-13T20:19:06.274 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:19:06.274 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:19:06.274 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:19:06.274 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:19:06.274 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:19:06.274 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:19:06.486 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:19:06.625 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:19:06.617+0000 7fdd10cc5a40 -1 osd.2 0 log_to_monitors true 2026-02-13T20:19:07.488 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:19:07.488 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:19:07.488 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:19:07.489 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T20:19:07.489 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:19:07.489 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T20:19:07.696 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3170502844,v1:127.0.0.1:6819/3170502844] [v2:127.0.0.1:6820/3170502844,v1:127.0.0.1:6821/3170502844] exists,up f7516977-77a5-4809-a1d0-6f139d4b1746 2026-02-13T20:19:07.697 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:19:07.697 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:19:07.697 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:19:07.698 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-13T20:19:07.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: osd_pid2=92851 2026-02-13T20:19:07.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:47: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 3 2026-02-13T20:19:07.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T20:19:07.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T20:19:07.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-13T20:19:07.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T20:19:07.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-13T20:19:07.701 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=ce57c786-d803-4303-8b97-0420bb37917f --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-13T20:19:07.701 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T20:19:07.701 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T20:19:07.701 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T20:19:07.701 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-13T20:19:07.701 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-13T20:19:07.701 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T20:19:07.701 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T20:19:07.701 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T20:19:07.701 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T20:19:07.701 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T20:19:07.701 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T20:19:07.701 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T20:19:07.702 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:19:07.702 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86753 2026-02-13T20:19:07.702 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.86753/$cluster-$name.asok' 2026-02-13T20:19:07.703 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.86753/$cluster-$name.asok' 2026-02-13T20:19:07.703 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T20:19:07.703 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T20:19:07.704 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T20:19:07.704 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T20:19:07.704 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T20:19:07.704 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T20:19:07.704 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T20:19:07.704 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T20:19:07.704 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T20:19:07.704 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T20:19:07.704 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T20:19:07.704 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-13T20:19:07.704 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T20:19:07.704 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=42da8f41-f050-49a5-bce3-cc26f935749f 2026-02-13T20:19:07.705 INFO:tasks.workunit.client.0.trial030.stdout:add osd3 42da8f41-f050-49a5-bce3-cc26f935749f 2026-02-13T20:19:07.705 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 42da8f41-f050-49a5-bce3-cc26f935749f' 2026-02-13T20:19:07.705 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T20:19:07.716 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA7h49p42+HKhAAssvnyTEdvgfZqUo86G0DHw== 2026-02-13T20:19:07.716 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA7h49p42+HKhAAssvnyTEdvgfZqUo86G0DHw=="}' 2026-02-13T20:19:07.716 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 42da8f41-f050-49a5-bce3-cc26f935749f -i td/osd-bluefs-volume-ops/3/new.json 2026-02-13T20:19:07.946 INFO:tasks.workunit.client.0.trial030.stdout:3 2026-02-13T20:19:07.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/3/new.json 2026-02-13T20:19:07.956 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=ce57c786-d803-4303-8b97-0420bb37917f --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.86753/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA7h49p42+HKhAAssvnyTEdvgfZqUo86G0DHw== --osd-uuid 42da8f41-f050-49a5-bce3-cc26f935749f 2026-02-13T20:19:07.972 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:19:07.965+0000 7f49b6978a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:19:07.974 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:19:07.965+0000 7f49b6978a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:19:07.974 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:19:07.969+0000 7f49b6978a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:19:07.975 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:19:07.969+0000 7f49b6978a40 -1 bdev(0x5591025a0400 td/osd-bluefs-volume-ops/3/block) open stat got: (1) Operation not permitted 2026-02-13T20:19:07.975 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:19:07.969+0000 7f49b6978a40 -1 bluestore(td/osd-bluefs-volume-ops/3) _read_fsid unparsable uuid 2026-02-13T20:19:09.420 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/3/keyring 2026-02-13T20:19:09.420 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T20:19:09.421 INFO:tasks.workunit.client.0.trial030.stdout:adding osd3 key to auth repository 2026-02-13T20:19:09.421 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-13T20:19:09.421 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T20:19:09.727 INFO:tasks.workunit.client.0.trial030.stdout:start osd.3 2026-02-13T20:19:09.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-13T20:19:09.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=ce57c786-d803-4303-8b97-0420bb37917f --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.86753/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T20:19:09.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T20:19:09.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T20:19:09.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T20:19:09.750 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:19:09.741+0000 7fe59b899a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:19:09.751 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:19:09.745+0000 7fe59b899a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:19:09.752 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:19:09.745+0000 7fe59b899a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T20:19:09.940 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-13T20:19:09.941 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T20:19:09.941 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T20:19:09.941 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T20:19:09.941 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T20:19:09.941 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:19:09.941 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-13T20:19:09.942 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T20:19:09.942 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:19:09.942 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T20:19:10.157 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:19:10.236 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:19:10.229+0000 7fe59b899a40 -1 Falling back to public interface 2026-02-13T20:19:11.158 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:19:11.158 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:19:11.158 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-13T20:19:11.159 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T20:19:11.159 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:19:11.159 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T20:19:11.324 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:19:11.317+0000 7fe59b899a40 -1 osd.3 0 log_to_monitors true 2026-02-13T20:19:11.373 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T20:19:12.375 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T20:19:12.375 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T20:19:12.375 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-13T20:19:12.375 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T20:19:12.375 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T20:19:12.375 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T20:19:12.593 INFO:tasks.workunit.client.0.trial030.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2114857753,v1:127.0.0.1:6827/2114857753] [v2:127.0.0.1:6828/2114857753,v1:127.0.0.1:6829/2114857753] exists,up 42da8f41-f050-49a5-bce3-cc26f935749f 2026-02-13T20:19:12.594 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T20:19:12.595 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T20:19:12.595 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T20:19:12.595 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-13T20:19:12.596 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: osd_pid3=95215 2026-02-13T20:19:12.596 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:50: TEST_bluestore: sleep 5 2026-02-13T20:19:17.596 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:52: TEST_bluestore: create_pool foo 16 2026-02-13T20:19:17.596 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-13T20:19:17.855 INFO:tasks.workunit.client.0.trial030.stderr:pool 'foo' already exists 2026-02-13T20:19:17.865 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T20:19:18.866 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:55: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-13T20:19:18.887 INFO:tasks.workunit.client.0.trial030.stdout:hints = 1 2026-02-13T20:19:18.887 INFO:tasks.workunit.client.0.trial030.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-13T20:19:18.887 INFO:tasks.workunit.client.0.trial030.stdout:Object prefix: benchmark_data_trial030_96290 2026-02-13T20:19:18.888 INFO:tasks.workunit.client.0.trial030.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-13T20:19:18.888 INFO:tasks.workunit.client.0.trial030.stdout: 0 0 0 0 0 0 - 0 2026-02-13T20:19:19.888 INFO:tasks.workunit.client.0.trial030.stdout: 1 16 10710 10694 41.7702 41.7734 0.00068694 0.00148924 2026-02-13T20:19:20.888 INFO:tasks.workunit.client.0.trial030.stdout: 2 16 21611 21595 42.1745 42.582 0.00143058 0.00148001 2026-02-13T20:19:21.888 INFO:tasks.workunit.client.0.trial030.stdout: 3 15 32491 32476 42.2831 42.5039 0.00133957 0.00147622 2026-02-13T20:19:22.888 INFO:tasks.workunit.client.0.trial030.stdout: 4 15 43446 43431 42.4097 42.793 0.00130772 0.00147201 2026-02-13T20:19:23.889 INFO:tasks.workunit.client.0.trial030.stdout: 5 16 54593 54577 42.6349 43.5391 0.00112124 0.00146429 2026-02-13T20:19:24.888 INFO:tasks.workunit.client.0.trial030.stdout: 6 16 65037 65021 42.328 40.7969 0.00100615 0.00147496 2026-02-13T20:19:25.888 INFO:tasks.workunit.client.0.trial030.stdout: 7 16 76223 76207 42.5228 43.6953 0.00132652 0.00146819 2026-02-13T20:19:26.888 INFO:tasks.workunit.client.0.trial030.stdout: 8 16 83605 83589 40.8117 28.8359 0.017117 0.00152155 2026-02-13T20:19:27.889 INFO:tasks.workunit.client.0.trial030.stdout: 9 16 93279 93263 40.4755 37.7891 0.00109725 0.00154256 2026-02-13T20:19:28.889 INFO:tasks.workunit.client.0.trial030.stdout: 10 16 104129 104113 40.6659 42.3828 0.00133794 0.00153538 2026-02-13T20:19:29.888 INFO:tasks.workunit.client.0.trial030.stdout: 11 16 115175 115159 40.8913 43.1484 0.00149147 0.00152694 2026-02-13T20:19:30.889 INFO:tasks.workunit.client.0.trial030.stdout: 12 16 126079 126063 41.0329 42.5938 0.00122099 0.00152163 2026-02-13T20:19:31.889 INFO:tasks.workunit.client.0.trial030.stdout: 13 16 136923 136907 41.1347 42.3594 0.00126362 0.00151787 2026-02-13T20:19:32.889 INFO:tasks.workunit.client.0.trial030.stdout: 14 16 139942 139926 39.0389 11.793 0.383186 0.00152663 2026-02-13T20:19:33.889 INFO:tasks.workunit.client.0.trial030.stdout: 15 16 140032 140016 36.4598 0.351562 0.0942084 0.00169845 2026-02-13T20:19:34.889 INFO:tasks.workunit.client.0.trial030.stdout: 16 16 140160 140144 34.2123 0.5 0.102846 0.00182076 2026-02-13T20:19:35.889 INFO:tasks.workunit.client.0.trial030.stdout: 17 16 149392 149376 34.3209 36.0625 0.00191801 0.00181956 2026-02-13T20:19:36.889 INFO:tasks.workunit.client.0.trial030.stdout: 18 16 158778 158762 34.4509 36.6641 0.00132381 0.00181265 2026-02-13T20:19:37.889 INFO:tasks.workunit.client.0.trial030.stdout: 19 16 168104 168088 34.5549 36.4297 0.0016748 0.00180709 2026-02-13T20:19:38.889 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-13T20:19:38.887845+0000 min lat: 0.000438079 max lat: 0.91076 avg lat: 0.0018018 2026-02-13T20:19:38.889 INFO:tasks.workunit.client.0.trial030.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-13T20:19:38.889 INFO:tasks.workunit.client.0.trial030.stdout: 20 16 177484 177468 34.6589 36.6406 0.0018245 0.0018018 2026-02-13T20:19:39.890 INFO:tasks.workunit.client.0.trial030.stdout: 21 16 186814 186798 34.7439 36.4453 0.00176826 0.00179738 2026-02-13T20:19:40.889 INFO:tasks.workunit.client.0.trial030.stdout: 22 16 189210 189194 33.59 9.35938 0.70259 0.00181463 2026-02-13T20:19:41.890 INFO:tasks.workunit.client.0.trial030.stdout: 23 16 189328 189312 32.1496 0.460938 0.0980402 0.00193961 2026-02-13T20:19:42.890 INFO:tasks.workunit.client.0.trial030.stdout: 24 16 197232 197216 32.0964 30.875 0.00296783 0.00194573 2026-02-13T20:19:43.890 INFO:tasks.workunit.client.0.trial030.stdout: 25 16 206518 206502 32.2634 36.2734 0.00150123 0.00193568 2026-02-13T20:19:44.890 INFO:tasks.workunit.client.0.trial030.stdout: 26 16 215773 215757 32.4128 36.1523 0.00148223 0.00192675 2026-02-13T20:19:45.890 INFO:tasks.workunit.client.0.trial030.stdout: 27 16 225190 225174 32.5747 36.7852 0.00150924 0.00191719 2026-02-13T20:19:46.890 INFO:tasks.workunit.client.0.trial030.stdout: 28 15 234415 234400 32.6983 36.0391 0.00181134 0.00190993 2026-02-13T20:19:47.890 INFO:tasks.workunit.client.0.trial030.stdout: 29 15 243672 243657 32.8176 36.1602 0.00137228 0.00190299 2026-02-13T20:19:48.890 INFO:tasks.workunit.client.0.trial030.stdout: 30 15 253010 252995 32.9394 36.4766 0.000919629 0.00189574 2026-02-13T20:19:49.891 INFO:tasks.workunit.client.0.trial030.stdout:Total time run: 30.0037 2026-02-13T20:19:49.891 INFO:tasks.workunit.client.0.trial030.stdout:Total writes made: 253010 2026-02-13T20:19:49.891 INFO:tasks.workunit.client.0.trial030.stdout:Write size: 4096 2026-02-13T20:19:49.891 INFO:tasks.workunit.client.0.trial030.stdout:Object size: 4096 2026-02-13T20:19:49.891 INFO:tasks.workunit.client.0.trial030.stdout:Bandwidth (MB/sec): 32.9399 2026-02-13T20:19:49.891 INFO:tasks.workunit.client.0.trial030.stdout:Stddev Bandwidth: 13.6106 2026-02-13T20:19:49.891 INFO:tasks.workunit.client.0.trial030.stdout:Max bandwidth (MB/sec): 43.6953 2026-02-13T20:19:49.891 INFO:tasks.workunit.client.0.trial030.stdout:Min bandwidth (MB/sec): 0.351562 2026-02-13T20:19:49.891 INFO:tasks.workunit.client.0.trial030.stdout:Average IOPS: 8432 2026-02-13T20:19:49.891 INFO:tasks.workunit.client.0.trial030.stdout:Stddev IOPS: 3484.31 2026-02-13T20:19:49.891 INFO:tasks.workunit.client.0.trial030.stdout:Max IOPS: 11186 2026-02-13T20:19:49.891 INFO:tasks.workunit.client.0.trial030.stdout:Min IOPS: 90 2026-02-13T20:19:49.891 INFO:tasks.workunit.client.0.trial030.stdout:Average Latency(s): 0.00189592 2026-02-13T20:19:49.891 INFO:tasks.workunit.client.0.trial030.stdout:Stddev Latency(s): 0.0107546 2026-02-13T20:19:49.892 INFO:tasks.workunit.client.0.trial030.stdout:Max latency(s): 0.91076 2026-02-13T20:19:49.892 INFO:tasks.workunit.client.0.trial030.stdout:Min latency(s): 0.000438079 2026-02-13T20:19:49.896 INFO:tasks.workunit.client.0.trial030.stdout:after bench 2026-02-13T20:19:49.896 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:57: TEST_bluestore: echo 'after bench' 2026-02-13T20:19:49.897 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 88128 2026-02-13T20:19:49.897 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: sleep 1 2026-02-13T20:19:50.898 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 88128 2026-02-13T20:19:50.898 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 60: kill: (88128) - No such process 2026-02-13T20:19:50.898 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:61: TEST_bluestore: ceph osd down 0 2026-02-13T20:19:51.107 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already down. 2026-02-13T20:19:51.116 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 90681 2026-02-13T20:19:51.116 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: sleep 1 2026-02-13T20:19:52.118 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 90681 2026-02-13T20:19:52.118 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 62: kill: (90681) - No such process 2026-02-13T20:19:52.118 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:63: TEST_bluestore: ceph osd down 1 2026-02-13T20:19:52.327 INFO:tasks.workunit.client.0.trial030.stderr:osd.1 is already down. 2026-02-13T20:19:52.337 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 92851 2026-02-13T20:19:52.337 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: sleep 1 2026-02-13T20:19:53.339 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 92851 2026-02-13T20:19:53.339 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 64: kill: (92851) - No such process 2026-02-13T20:19:53.339 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:65: TEST_bluestore: ceph osd down 2 2026-02-13T20:19:53.545 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already down. 2026-02-13T20:19:53.555 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: kill 95215 2026-02-13T20:19:53.556 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: sleep 1 2026-02-13T20:19:54.557 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: kill 95215 2026-02-13T20:19:54.557 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 66: kill: (95215) - No such process 2026-02-13T20:19:54.557 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:67: TEST_bluestore: ceph osd down 3 2026-02-13T20:19:54.817 INFO:tasks.workunit.client.0.trial030.stderr:osd.3 is already down. 2026-02-13T20:19:54.826 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:70: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-13T20:19:58.791 INFO:tasks.workunit.client.0.trial030.stdout:fsck success 2026-02-13T20:19:58.830 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:71: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-13T20:20:02.863 INFO:tasks.workunit.client.0.trial030.stdout:fsck success 2026-02-13T20:20:02.903 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:72: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-13T20:20:06.871 INFO:tasks.workunit.client.0.trial030.stdout:fsck success 2026-02-13T20:20:06.908 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:73: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-13T20:20:10.983 INFO:tasks.workunit.client.0.trial030.stdout:fsck success 2026-02-13T20:20:11.021 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:75: TEST_bluestore: truncate td/osd-bluefs-volume-ops/0/block -s 4294967296 2026-02-13T20:20:11.022 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:76: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand 2026-02-13T20:20:11.042 INFO:tasks.workunit.client.0.trial030.stdout:inferring bluefs devices from bluestore path 2026-02-13T20:20:14.371 INFO:tasks.workunit.client.0.trial030.stdout:0 : device size 0x20000000(512 MiB) : using 0x16d00000(365 MiB) 2026-02-13T20:20:14.371 INFO:tasks.workunit.client.0.trial030.stdout:1 : device size 0x40000000(1 GiB) : using 0xe00000(14 MiB) 2026-02-13T20:20:14.371 INFO:tasks.workunit.client.0.trial030.stdout:2 : device size 0x100000000(4 GiB) : using 0xae5e7000(2.7 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0xae5e7000(2.7 GiB) 2026-02-13T20:20:14.371 INFO:tasks.workunit.client.0.trial030.stdout:Expanding DB/WAL... 2026-02-13T20:20:14.371 INFO:tasks.workunit.client.0.trial030.stdout:0 : nothing to do, skipped 2026-02-13T20:20:14.371 INFO:tasks.workunit.client.0.trial030.stdout:1 : nothing to do, skipped 2026-02-13T20:20:14.371 INFO:tasks.workunit.client.0.trial030.stdout:2 : Expanding to 0x100000000(4 GiB) 2026-02-13T20:20:14.372 INFO:tasks.workunit.client.0.trial030.stdout:2 : size updated to 0x100000000(4 GiB) 2026-02-13T20:20:17.898 INFO:tasks.workunit.client.0.trial030.stderr:./src/os/bluestore/BlueStore.h: In function 'virtual void RocksDBBlueFSVolumeSelector::sub_usage(void*, uint64_t, bool)' thread 7fefecfbed40 time 2026-02-13T20:20:17.895529+0000 2026-02-13T20:20:17.898 INFO:tasks.workunit.client.0.trial030.stderr:./src/os/bluestore/BlueStore.h: 4588: FAILED ceph_assert(cur >= size_less) 2026-02-13T20:20:17.899 INFO:tasks.workunit.client.0.trial030.stderr: ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None) 2026-02-13T20:20:17.899 INFO:tasks.workunit.client.0.trial030.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x137) [0x7fefeeae8ecf] 2026-02-13T20:20:17.900 INFO:tasks.workunit.client.0.trial030.stderr: 2: ceph-bluestore-tool(+0x18a6d6) [0x55a476f4e6d6] 2026-02-13T20:20:17.900 INFO:tasks.workunit.client.0.trial030.stderr: 3: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x55a4770555e2] 2026-02-13T20:20:17.900 INFO:tasks.workunit.client.0.trial030.stderr: 4: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x55a4770757c3] 2026-02-13T20:20:17.900 INFO:tasks.workunit.client.0.trial030.stderr: 5: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x55a4771a8377] 2026-02-13T20:20:17.900 INFO:tasks.workunit.client.0.trial030.stderr: 6: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x55a47735b503] 2026-02-13T20:20:17.900 INFO:tasks.workunit.client.0.trial030.stderr: 7: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x55a4772532e3] 2026-02-13T20:20:17.900 INFO:tasks.workunit.client.0.trial030.stderr: 8: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55a47725871e] 2026-02-13T20:20:17.900 INFO:tasks.workunit.client.0.trial030.stderr: 9: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55a477259009] 2026-02-13T20:20:17.900 INFO:tasks.workunit.client.0.trial030.stderr: 10: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x55a4772670c2] 2026-02-13T20:20:17.900 INFO:tasks.workunit.client.0.trial030.stderr: 11: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x55a477268628] 2026-02-13T20:20:17.901 INFO:tasks.workunit.client.0.trial030.stderr: 12: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55a47701b6d4] 2026-02-13T20:20:17.901 INFO:tasks.workunit.client.0.trial030.stderr: 13: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55a4770c9022] 2026-02-13T20:20:17.901 INFO:tasks.workunit.client.0.trial030.stderr: 14: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55a4770c9ee4] 2026-02-13T20:20:17.901 INFO:tasks.workunit.client.0.trial030.stderr: 15: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55a4770d371d] 2026-02-13T20:20:17.901 INFO:tasks.workunit.client.0.trial030.stderr: 16: main() 2026-02-13T20:20:17.901 INFO:tasks.workunit.client.0.trial030.stderr: 17: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fefee1afd90] 2026-02-13T20:20:17.901 INFO:tasks.workunit.client.0.trial030.stderr: 18: __libc_start_main() 2026-02-13T20:20:17.901 INFO:tasks.workunit.client.0.trial030.stderr: 19: _start() 2026-02-13T20:20:17.901 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:20:17.890+0000 7fefecfbed40 -1 ./src/os/bluestore/BlueStore.h: In function 'virtual void RocksDBBlueFSVolumeSelector::sub_usage(void*, uint64_t, bool)' thread 7fefecfbed40 time 2026-02-13T20:20:17.895529+0000 2026-02-13T20:20:17.901 INFO:tasks.workunit.client.0.trial030.stderr:./src/os/bluestore/BlueStore.h: 4588: FAILED ceph_assert(cur >= size_less) 2026-02-13T20:20:17.901 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-13T20:20:17.901 INFO:tasks.workunit.client.0.trial030.stderr: ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None) 2026-02-13T20:20:17.902 INFO:tasks.workunit.client.0.trial030.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x137) [0x7fefeeae8ecf] 2026-02-13T20:20:17.902 INFO:tasks.workunit.client.0.trial030.stderr: 2: ceph-bluestore-tool(+0x18a6d6) [0x55a476f4e6d6] 2026-02-13T20:20:17.902 INFO:tasks.workunit.client.0.trial030.stderr: 3: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x55a4770555e2] 2026-02-13T20:20:17.902 INFO:tasks.workunit.client.0.trial030.stderr: 4: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x55a4770757c3] 2026-02-13T20:20:17.902 INFO:tasks.workunit.client.0.trial030.stderr: 5: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x55a4771a8377] 2026-02-13T20:20:17.902 INFO:tasks.workunit.client.0.trial030.stderr: 6: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x55a47735b503] 2026-02-13T20:20:17.902 INFO:tasks.workunit.client.0.trial030.stderr: 7: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x55a4772532e3] 2026-02-13T20:20:17.902 INFO:tasks.workunit.client.0.trial030.stderr: 8: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55a47725871e] 2026-02-13T20:20:17.902 INFO:tasks.workunit.client.0.trial030.stderr: 9: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55a477259009] 2026-02-13T20:20:17.902 INFO:tasks.workunit.client.0.trial030.stderr: 10: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x55a4772670c2] 2026-02-13T20:20:17.902 INFO:tasks.workunit.client.0.trial030.stderr: 11: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x55a477268628] 2026-02-13T20:20:17.902 INFO:tasks.workunit.client.0.trial030.stderr: 12: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55a47701b6d4] 2026-02-13T20:20:17.903 INFO:tasks.workunit.client.0.trial030.stderr: 13: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55a4770c9022] 2026-02-13T20:20:17.903 INFO:tasks.workunit.client.0.trial030.stderr: 14: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55a4770c9ee4] 2026-02-13T20:20:17.903 INFO:tasks.workunit.client.0.trial030.stderr: 15: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55a4770d371d] 2026-02-13T20:20:17.903 INFO:tasks.workunit.client.0.trial030.stderr: 16: main() 2026-02-13T20:20:17.903 INFO:tasks.workunit.client.0.trial030.stderr: 17: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fefee1afd90] 2026-02-13T20:20:17.903 INFO:tasks.workunit.client.0.trial030.stderr: 18: __libc_start_main() 2026-02-13T20:20:17.903 INFO:tasks.workunit.client.0.trial030.stderr: 19: _start() 2026-02-13T20:20:17.903 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-13T20:20:17.903 INFO:tasks.workunit.client.0.trial030.stderr:*** Caught signal (Aborted) ** 2026-02-13T20:20:17.903 INFO:tasks.workunit.client.0.trial030.stderr: in thread 7fefecfbed40 thread_name:ceph-bluestore- 2026-02-13T20:20:17.903 INFO:tasks.workunit.client.0.trial030.stderr: ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None) 2026-02-13T20:20:17.903 INFO:tasks.workunit.client.0.trial030.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fefee1c8520] 2026-02-13T20:20:17.903 INFO:tasks.workunit.client.0.trial030.stderr: 2: pthread_kill() 2026-02-13T20:20:17.904 INFO:tasks.workunit.client.0.trial030.stderr: 3: raise() 2026-02-13T20:20:17.904 INFO:tasks.workunit.client.0.trial030.stderr: 4: abort() 2026-02-13T20:20:17.904 INFO:tasks.workunit.client.0.trial030.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7fefeeae8f2e] 2026-02-13T20:20:17.904 INFO:tasks.workunit.client.0.trial030.stderr: 6: ceph-bluestore-tool(+0x18a6d6) [0x55a476f4e6d6] 2026-02-13T20:20:17.904 INFO:tasks.workunit.client.0.trial030.stderr: 7: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x55a4770555e2] 2026-02-13T20:20:17.904 INFO:tasks.workunit.client.0.trial030.stderr: 8: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x55a4770757c3] 2026-02-13T20:20:17.904 INFO:tasks.workunit.client.0.trial030.stderr: 9: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x55a4771a8377] 2026-02-13T20:20:17.904 INFO:tasks.workunit.client.0.trial030.stderr: 10: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x55a47735b503] 2026-02-13T20:20:17.904 INFO:tasks.workunit.client.0.trial030.stderr: 11: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x55a4772532e3] 2026-02-13T20:20:17.904 INFO:tasks.workunit.client.0.trial030.stderr: 12: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55a47725871e] 2026-02-13T20:20:17.904 INFO:tasks.workunit.client.0.trial030.stderr: 13: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55a477259009] 2026-02-13T20:20:17.904 INFO:tasks.workunit.client.0.trial030.stderr: 14: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x55a4772670c2] 2026-02-13T20:20:17.905 INFO:tasks.workunit.client.0.trial030.stderr: 15: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x55a477268628] 2026-02-13T20:20:17.905 INFO:tasks.workunit.client.0.trial030.stderr: 16: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55a47701b6d4] 2026-02-13T20:20:17.905 INFO:tasks.workunit.client.0.trial030.stderr: 17: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55a4770c9022] 2026-02-13T20:20:17.905 INFO:tasks.workunit.client.0.trial030.stderr: 18: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55a4770c9ee4] 2026-02-13T20:20:17.905 INFO:tasks.workunit.client.0.trial030.stderr: 19: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55a4770d371d] 2026-02-13T20:20:17.905 INFO:tasks.workunit.client.0.trial030.stderr: 20: main() 2026-02-13T20:20:17.905 INFO:tasks.workunit.client.0.trial030.stderr: 21: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fefee1afd90] 2026-02-13T20:20:17.905 INFO:tasks.workunit.client.0.trial030.stderr: 22: __libc_start_main() 2026-02-13T20:20:17.905 INFO:tasks.workunit.client.0.trial030.stderr: 23: _start() 2026-02-13T20:20:17.905 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-13T20:20:17.890+0000 7fefecfbed40 -1 *** Caught signal (Aborted) ** 2026-02-13T20:20:17.905 INFO:tasks.workunit.client.0.trial030.stderr: in thread 7fefecfbed40 thread_name:ceph-bluestore- 2026-02-13T20:20:17.905 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-13T20:20:17.906 INFO:tasks.workunit.client.0.trial030.stderr: ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None) 2026-02-13T20:20:17.906 INFO:tasks.workunit.client.0.trial030.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fefee1c8520] 2026-02-13T20:20:17.906 INFO:tasks.workunit.client.0.trial030.stderr: 2: pthread_kill() 2026-02-13T20:20:17.906 INFO:tasks.workunit.client.0.trial030.stderr: 3: raise() 2026-02-13T20:20:17.906 INFO:tasks.workunit.client.0.trial030.stderr: 4: abort() 2026-02-13T20:20:17.906 INFO:tasks.workunit.client.0.trial030.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7fefeeae8f2e] 2026-02-13T20:20:17.906 INFO:tasks.workunit.client.0.trial030.stderr: 6: ceph-bluestore-tool(+0x18a6d6) [0x55a476f4e6d6] 2026-02-13T20:20:17.906 INFO:tasks.workunit.client.0.trial030.stderr: 7: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x55a4770555e2] 2026-02-13T20:20:17.906 INFO:tasks.workunit.client.0.trial030.stderr: 8: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x55a4770757c3] 2026-02-13T20:20:17.906 INFO:tasks.workunit.client.0.trial030.stderr: 9: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x55a4771a8377] 2026-02-13T20:20:17.906 INFO:tasks.workunit.client.0.trial030.stderr: 10: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x55a47735b503] 2026-02-13T20:20:17.906 INFO:tasks.workunit.client.0.trial030.stderr: 11: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x55a4772532e3] 2026-02-13T20:20:17.907 INFO:tasks.workunit.client.0.trial030.stderr: 12: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55a47725871e] 2026-02-13T20:20:17.907 INFO:tasks.workunit.client.0.trial030.stderr: 13: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55a477259009] 2026-02-13T20:20:17.907 INFO:tasks.workunit.client.0.trial030.stderr: 14: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x55a4772670c2] 2026-02-13T20:20:17.907 INFO:tasks.workunit.client.0.trial030.stderr: 15: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x55a477268628] 2026-02-13T20:20:17.907 INFO:tasks.workunit.client.0.trial030.stderr: 16: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55a47701b6d4] 2026-02-13T20:20:17.907 INFO:tasks.workunit.client.0.trial030.stderr: 17: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55a4770c9022] 2026-02-13T20:20:17.907 INFO:tasks.workunit.client.0.trial030.stderr: 18: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55a4770c9ee4] 2026-02-13T20:20:17.907 INFO:tasks.workunit.client.0.trial030.stderr: 19: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55a4770d371d] 2026-02-13T20:20:17.907 INFO:tasks.workunit.client.0.trial030.stderr: 20: main() 2026-02-13T20:20:17.907 INFO:tasks.workunit.client.0.trial030.stderr: 21: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fefee1afd90] 2026-02-13T20:20:17.907 INFO:tasks.workunit.client.0.trial030.stderr: 22: __libc_start_main() 2026-02-13T20:20:17.907 INFO:tasks.workunit.client.0.trial030.stderr: 23: _start() 2026-02-13T20:20:17.907 INFO:tasks.workunit.client.0.trial030.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2026-02-13T20:20:17.908 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-13T20:20:17.908 INFO:tasks.workunit.client.0.trial030.stderr: -499> 2026-02-13T20:20:17.890+0000 7fefecfbed40 -1 ./src/os/bluestore/BlueStore.h: In function 'virtual void RocksDBBlueFSVolumeSelector::sub_usage(void*, uint64_t, bool)' thread 7fefecfbed40 time 2026-02-13T20:20:17.895529+0000 2026-02-13T20:20:17.908 INFO:tasks.workunit.client.0.trial030.stderr:./src/os/bluestore/BlueStore.h: 4588: FAILED ceph_assert(cur >= size_less) 2026-02-13T20:20:17.908 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-13T20:20:17.908 INFO:tasks.workunit.client.0.trial030.stderr: ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None) 2026-02-13T20:20:17.908 INFO:tasks.workunit.client.0.trial030.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x137) [0x7fefeeae8ecf] 2026-02-13T20:20:17.908 INFO:tasks.workunit.client.0.trial030.stderr: 2: ceph-bluestore-tool(+0x18a6d6) [0x55a476f4e6d6] 2026-02-13T20:20:17.908 INFO:tasks.workunit.client.0.trial030.stderr: 3: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x55a4770555e2] 2026-02-13T20:20:17.908 INFO:tasks.workunit.client.0.trial030.stderr: 4: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x55a4770757c3] 2026-02-13T20:20:17.908 INFO:tasks.workunit.client.0.trial030.stderr: 5: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x55a4771a8377] 2026-02-13T20:20:17.908 INFO:tasks.workunit.client.0.trial030.stderr: 6: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x55a47735b503] 2026-02-13T20:20:17.909 INFO:tasks.workunit.client.0.trial030.stderr: 7: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x55a4772532e3] 2026-02-13T20:20:17.909 INFO:tasks.workunit.client.0.trial030.stderr: 8: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55a47725871e] 2026-02-13T20:20:17.909 INFO:tasks.workunit.client.0.trial030.stderr: 9: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55a477259009] 2026-02-13T20:20:17.909 INFO:tasks.workunit.client.0.trial030.stderr: 10: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x55a4772670c2] 2026-02-13T20:20:17.909 INFO:tasks.workunit.client.0.trial030.stderr: 11: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x55a477268628] 2026-02-13T20:20:17.909 INFO:tasks.workunit.client.0.trial030.stderr: 12: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55a47701b6d4] 2026-02-13T20:20:17.909 INFO:tasks.workunit.client.0.trial030.stderr: 13: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55a4770c9022] 2026-02-13T20:20:17.909 INFO:tasks.workunit.client.0.trial030.stderr: 14: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55a4770c9ee4] 2026-02-13T20:20:17.909 INFO:tasks.workunit.client.0.trial030.stderr: 15: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55a4770d371d] 2026-02-13T20:20:17.909 INFO:tasks.workunit.client.0.trial030.stderr: 16: main() 2026-02-13T20:20:17.909 INFO:tasks.workunit.client.0.trial030.stderr: 17: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fefee1afd90] 2026-02-13T20:20:17.909 INFO:tasks.workunit.client.0.trial030.stderr: 18: __libc_start_main() 2026-02-13T20:20:17.910 INFO:tasks.workunit.client.0.trial030.stderr: 19: _start() 2026-02-13T20:20:17.910 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-13T20:20:17.910 INFO:tasks.workunit.client.0.trial030.stderr: -498> 2026-02-13T20:20:17.890+0000 7fefecfbed40 -1 *** Caught signal (Aborted) ** 2026-02-13T20:20:17.910 INFO:tasks.workunit.client.0.trial030.stderr: in thread 7fefecfbed40 thread_name:ceph-bluestore- 2026-02-13T20:20:17.910 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-13T20:20:17.910 INFO:tasks.workunit.client.0.trial030.stderr: ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None) 2026-02-13T20:20:17.911 INFO:tasks.workunit.client.0.trial030.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fefee1c8520] 2026-02-13T20:20:17.911 INFO:tasks.workunit.client.0.trial030.stderr: 2: pthread_kill() 2026-02-13T20:20:17.911 INFO:tasks.workunit.client.0.trial030.stderr: 3: raise() 2026-02-13T20:20:17.911 INFO:tasks.workunit.client.0.trial030.stderr: 4: abort() 2026-02-13T20:20:17.911 INFO:tasks.workunit.client.0.trial030.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7fefeeae8f2e] 2026-02-13T20:20:17.911 INFO:tasks.workunit.client.0.trial030.stderr: 6: ceph-bluestore-tool(+0x18a6d6) [0x55a476f4e6d6] 2026-02-13T20:20:17.911 INFO:tasks.workunit.client.0.trial030.stderr: 7: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x55a4770555e2] 2026-02-13T20:20:17.912 INFO:tasks.workunit.client.0.trial030.stderr: 8: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x55a4770757c3] 2026-02-13T20:20:17.912 INFO:tasks.workunit.client.0.trial030.stderr: 9: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x55a4771a8377] 2026-02-13T20:20:17.912 INFO:tasks.workunit.client.0.trial030.stderr: 10: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x55a47735b503] 2026-02-13T20:20:17.912 INFO:tasks.workunit.client.0.trial030.stderr: 11: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x55a4772532e3] 2026-02-13T20:20:17.912 INFO:tasks.workunit.client.0.trial030.stderr: 12: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55a47725871e] 2026-02-13T20:20:17.912 INFO:tasks.workunit.client.0.trial030.stderr: 13: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55a477259009] 2026-02-13T20:20:17.912 INFO:tasks.workunit.client.0.trial030.stderr: 14: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x55a4772670c2] 2026-02-13T20:20:17.913 INFO:tasks.workunit.client.0.trial030.stderr: 15: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x55a477268628] 2026-02-13T20:20:17.913 INFO:tasks.workunit.client.0.trial030.stderr: 16: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55a47701b6d4] 2026-02-13T20:20:17.913 INFO:tasks.workunit.client.0.trial030.stderr: 17: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55a4770c9022] 2026-02-13T20:20:17.913 INFO:tasks.workunit.client.0.trial030.stderr: 18: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55a4770c9ee4] 2026-02-13T20:20:17.913 INFO:tasks.workunit.client.0.trial030.stderr: 19: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55a4770d371d] 2026-02-13T20:20:17.913 INFO:tasks.workunit.client.0.trial030.stderr: 20: main() 2026-02-13T20:20:17.914 INFO:tasks.workunit.client.0.trial030.stderr: 21: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fefee1afd90] 2026-02-13T20:20:17.914 INFO:tasks.workunit.client.0.trial030.stderr: 22: __libc_start_main() 2026-02-13T20:20:17.914 INFO:tasks.workunit.client.0.trial030.stderr: 23: _start() 2026-02-13T20:20:17.914 INFO:tasks.workunit.client.0.trial030.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2026-02-13T20:20:17.914 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-13T20:20:17.914 INFO:tasks.workunit.client.0.trial030.stderr: -499> 2026-02-13T20:20:17.890+0000 7fefecfbed40 -1 ./src/os/bluestore/BlueStore.h: In function 'virtual void RocksDBBlueFSVolumeSelector::sub_usage(void*, uint64_t, bool)' thread 7fefecfbed40 time 2026-02-13T20:20:17.895529+0000 2026-02-13T20:20:17.914 INFO:tasks.workunit.client.0.trial030.stderr:./src/os/bluestore/BlueStore.h: 4588: FAILED ceph_assert(cur >= size_less) 2026-02-13T20:20:17.915 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-13T20:20:17.915 INFO:tasks.workunit.client.0.trial030.stderr: ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None) 2026-02-13T20:20:17.915 INFO:tasks.workunit.client.0.trial030.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x137) [0x7fefeeae8ecf] 2026-02-13T20:20:17.915 INFO:tasks.workunit.client.0.trial030.stderr: 2: ceph-bluestore-tool(+0x18a6d6) [0x55a476f4e6d6] 2026-02-13T20:20:17.915 INFO:tasks.workunit.client.0.trial030.stderr: 3: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x55a4770555e2] 2026-02-13T20:20:17.915 INFO:tasks.workunit.client.0.trial030.stderr: 4: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x55a4770757c3] 2026-02-13T20:20:17.916 INFO:tasks.workunit.client.0.trial030.stderr: 5: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x55a4771a8377] 2026-02-13T20:20:17.916 INFO:tasks.workunit.client.0.trial030.stderr: 6: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x55a47735b503] 2026-02-13T20:20:17.916 INFO:tasks.workunit.client.0.trial030.stderr: 7: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x55a4772532e3] 2026-02-13T20:20:17.916 INFO:tasks.workunit.client.0.trial030.stderr: 8: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55a47725871e] 2026-02-13T20:20:17.916 INFO:tasks.workunit.client.0.trial030.stderr: 9: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55a477259009] 2026-02-13T20:20:17.916 INFO:tasks.workunit.client.0.trial030.stderr: 10: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x55a4772670c2] 2026-02-13T20:20:17.916 INFO:tasks.workunit.client.0.trial030.stderr: 11: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x55a477268628] 2026-02-13T20:20:17.917 INFO:tasks.workunit.client.0.trial030.stderr: 12: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55a47701b6d4] 2026-02-13T20:20:17.917 INFO:tasks.workunit.client.0.trial030.stderr: 13: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55a4770c9022] 2026-02-13T20:20:17.917 INFO:tasks.workunit.client.0.trial030.stderr: 14: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55a4770c9ee4] 2026-02-13T20:20:17.917 INFO:tasks.workunit.client.0.trial030.stderr: 15: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55a4770d371d] 2026-02-13T20:20:17.917 INFO:tasks.workunit.client.0.trial030.stderr: 16: main() 2026-02-13T20:20:17.917 INFO:tasks.workunit.client.0.trial030.stderr: 17: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fefee1afd90] 2026-02-13T20:20:17.918 INFO:tasks.workunit.client.0.trial030.stderr: 18: __libc_start_main() 2026-02-13T20:20:17.918 INFO:tasks.workunit.client.0.trial030.stderr: 19: _start() 2026-02-13T20:20:17.918 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-13T20:20:17.918 INFO:tasks.workunit.client.0.trial030.stderr: -498> 2026-02-13T20:20:17.890+0000 7fefecfbed40 -1 *** Caught signal (Aborted) ** 2026-02-13T20:20:17.918 INFO:tasks.workunit.client.0.trial030.stderr: in thread 7fefecfbed40 thread_name:ceph-bluestore- 2026-02-13T20:20:17.918 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-13T20:20:17.918 INFO:tasks.workunit.client.0.trial030.stderr: ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None) 2026-02-13T20:20:17.919 INFO:tasks.workunit.client.0.trial030.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fefee1c8520] 2026-02-13T20:20:17.919 INFO:tasks.workunit.client.0.trial030.stderr: 2: pthread_kill() 2026-02-13T20:20:17.919 INFO:tasks.workunit.client.0.trial030.stderr: 3: raise() 2026-02-13T20:20:17.919 INFO:tasks.workunit.client.0.trial030.stderr: 4: abort() 2026-02-13T20:20:17.919 INFO:tasks.workunit.client.0.trial030.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7fefeeae8f2e] 2026-02-13T20:20:17.919 INFO:tasks.workunit.client.0.trial030.stderr: 6: ceph-bluestore-tool(+0x18a6d6) [0x55a476f4e6d6] 2026-02-13T20:20:17.920 INFO:tasks.workunit.client.0.trial030.stderr: 7: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x55a4770555e2] 2026-02-13T20:20:17.920 INFO:tasks.workunit.client.0.trial030.stderr: 8: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x55a4770757c3] 2026-02-13T20:20:17.920 INFO:tasks.workunit.client.0.trial030.stderr: 9: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x55a4771a8377] 2026-02-13T20:20:17.920 INFO:tasks.workunit.client.0.trial030.stderr: 10: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x55a47735b503] 2026-02-13T20:20:17.920 INFO:tasks.workunit.client.0.trial030.stderr: 11: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x55a4772532e3] 2026-02-13T20:20:17.920 INFO:tasks.workunit.client.0.trial030.stderr: 12: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55a47725871e] 2026-02-13T20:20:17.921 INFO:tasks.workunit.client.0.trial030.stderr: 13: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55a477259009] 2026-02-13T20:20:17.921 INFO:tasks.workunit.client.0.trial030.stderr: 14: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x55a4772670c2] 2026-02-13T20:20:17.921 INFO:tasks.workunit.client.0.trial030.stderr: 15: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x55a477268628] 2026-02-13T20:20:17.921 INFO:tasks.workunit.client.0.trial030.stderr: 16: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55a47701b6d4] 2026-02-13T20:20:17.921 INFO:tasks.workunit.client.0.trial030.stderr: 17: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55a4770c9022] 2026-02-13T20:20:17.921 INFO:tasks.workunit.client.0.trial030.stderr: 18: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55a4770c9ee4] 2026-02-13T20:20:17.922 INFO:tasks.workunit.client.0.trial030.stderr: 19: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55a4770d371d] 2026-02-13T20:20:17.922 INFO:tasks.workunit.client.0.trial030.stderr: 20: main() 2026-02-13T20:20:17.922 INFO:tasks.workunit.client.0.trial030.stderr: 21: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fefee1afd90] 2026-02-13T20:20:17.922 INFO:tasks.workunit.client.0.trial030.stderr: 22: __libc_start_main() 2026-02-13T20:20:17.922 INFO:tasks.workunit.client.0.trial030.stderr: 23: _start() 2026-02-13T20:20:17.922 INFO:tasks.workunit.client.0.trial030.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2026-02-13T20:20:17.922 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-13T20:20:18.219 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 19: 97920 Aborted (core dumped) ceph-bluestore-tool --path $dir/0 bluefs-bdev-expand 2026-02-13T20:20:18.219 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:76: TEST_bluestore: return 1 2026-02-13T20:20:18.219 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: return 1 2026-02-13T20:20:18.219 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: main: code=1 2026-02-13T20:20:18.219 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-bluefs-volume-ops 1 2026-02-13T20:20:18.220 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-13T20:20:18.220 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=1 2026-02-13T20:20:18.220 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-13T20:20:18.220 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T20:20:18.220 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T20:20:18.220 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T20:20:18.220 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T20:20:18.220 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T20:20:18.329 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T20:20:18.329 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T20:20:18.330 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T20:20:18.331 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T20:20:18.332 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T20:20:18.332 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T20:20:18.332 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T20:20:18.333 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:20:18.334 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T20:20:18.334 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T20:20:18.334 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:20:18.335 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:20:18.336 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: cores=yes 2026-02-13T20:20:18.336 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:173: teardown: '[' -n '' ']' 2026-02-13T20:20:18.336 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' yes = yes -o 1 = 1 ']' 2026-02-13T20:20:18.337 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:181: teardown: '[' -n '' ']' 2026-02-13T20:20:18.337 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:185: teardown: mkdir -p /home/ubuntu/cephtest/archive/log 2026-02-13T20:20:18.337 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:186: teardown: mv td/osd-bluefs-volume-ops/mgr.x.log td/osd-bluefs-volume-ops/mon.a.log td/osd-bluefs-volume-ops/osd.0.log td/osd-bluefs-volume-ops/osd.1.log td/osd-bluefs-volume-ops/osd.2.log td/osd-bluefs-volume-ops/osd.3.log /home/ubuntu/cephtest/archive/log 2026-02-13T20:20:18.339 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-13T20:20:18.488 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T20:20:18.488 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T20:20:18.488 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86753 2026-02-13T20:20:18.489 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.86753 2026-02-13T20:20:18.489 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' yes = yes ']' 2026-02-13T20:20:18.489 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:192: teardown: echo 'ERROR: Failure due to cores found' 2026-02-13T20:20:18.490 INFO:tasks.workunit.client.0.trial030.stdout:ERROR: Failure due to cores found 2026-02-13T20:20:18.490 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T20:20:18.491 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:193: teardown: '[' -n '' ']' 2026-02-13T20:20:18.491 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:196: teardown: return 1 2026-02-13T20:20:18.491 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: return 1 2026-02-13T20:20:18.491 INFO:tasks.workunit:Stopping ['osd'] on client.0... 2026-02-13T20:20:18.492 DEBUG:teuthology.orchestra.run.trial030:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-13T20:20:18.862 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa/tasks/workunit.py", line 144, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa/tasks/workunit.py", line 292, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa/tasks/workunit.py", line 433, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/remote.py", line 575, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on trial030 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=afefaa40503a4bf024e96f97dd7f852b75f00ad6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh' 2026-02-13T20:20:18.866 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-13T20:20:18.882 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-13T20:20:18.882 DEBUG:teuthology.orchestra.run.trial030:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T20:20:18.951 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-13T20:20:18.962 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-13T20:20:18.962 DEBUG:teuthology.orchestra.run.trial030:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T20:20:19.301 INFO:teuthology.orchestra.run.trial030.stdout: remote refid st t when poll reach delay offset jitter 2026-02-13T20:20:19.301 INFO:teuthology.orchestra.run.trial030.stdout:============================================================================== 2026-02-13T20:20:19.301 INFO:teuthology.orchestra.run.trial030.stdout:+sensei.ruselabs 38.6.228.170 2 u 19 64 377 68.484 -1.115 2.601 2026-02-13T20:20:19.301 INFO:teuthology.orchestra.run.trial030.stdout:+44.190.5.123 17.253.16.253 2 u 24 64 377 64.564 -1.710 2.410 2026-02-13T20:20:19.301 INFO:teuthology.orchestra.run.trial030.stdout:-172-232-15-202. 80.192.165.246 2 u 27 64 377 27.315 +6.554 3.066 2026-02-13T20:20:19.301 INFO:teuthology.orchestra.run.trial030.stdout:*159.203.158.197 206.108.0.132 2 u 18 64 377 3.878 -2.079 2.476 2026-02-13T20:20:19.302 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-13T20:20:19.316 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-13T20:20:19.317 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-13T20:20:19.331 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-13T20:20:19.346 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-13T20:20:19.360 INFO:teuthology.task.internal:Duration was 898.646691 seconds 2026-02-13T20:20:19.360 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-13T20:20:19.371 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-13T20:20:19.371 DEBUG:teuthology.orchestra.run.trial030:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T20:20:19.396 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-13T20:20:19.397 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial030.front.sepia.ceph.com 2026-02-13T20:20:19.397 DEBUG:teuthology.orchestra.run.trial030:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T20:20:19.445 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-13T20:20:19.445 DEBUG:teuthology.orchestra.run.trial030:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T20:20:19.640 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-13T20:20:19.640 DEBUG:teuthology.orchestra.run.trial030:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T20:20:19.649 INFO:teuthology.orchestra.run.trial030.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T20:20:19.649 INFO:teuthology.orchestra.run.trial030.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T20:20:19.649 INFO:teuthology.orchestra.run.trial030.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T20:20:19.649 INFO:teuthology.orchestra.run.trial030.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T20:20:19.650 INFO:teuthology.orchestra.run.trial030.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T20:20:19.695 INFO:teuthology.orchestra.run.trial030.stderr: 81.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T20:20:19.697 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-13T20:20:19.713 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-13T20:20:19.713 DEBUG:teuthology.orchestra.run.trial030:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T20:20:19.746 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-13T20:20:19.764 DEBUG:teuthology.orchestra.run.trial030:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:20:19.795 INFO:teuthology.orchestra.run.trial030.stdout:kernel.core_pattern = core 2026-02-13T20:20:19.806 DEBUG:teuthology.orchestra.run.trial030:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:20:19.853 WARNING:teuthology.task.internal:Found coredumps on ubuntu@trial030.front.sepia.ceph.com, flagging run as failed 2026-02-13T20:20:19.854 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-13T20:20:19.865 INFO:teuthology.task.internal:Transferring archived files... 2026-02-13T20:20:19.869 DEBUG:teuthology.misc:Transferring archived files from trial030:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49983/remote/trial030 2026-02-13T20:20:19.870 DEBUG:teuthology.orchestra.run.trial030:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T20:24:43.256 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2026-02-13T20:24:43.268 INFO:teuthology.task.internal: core looks like: /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49983/remote/trial030/coredump/1771014017.97920.core.gz: gzip compressed data, was "1771014017.97920.core", last modified: Fri Feb 13 20:20:19 2026, max compression, original size modulo 2^32 389255168 2026-02-13T20:24:43.268 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2026-02-13T20:24:43.963 INFO:teuthology.task.internal: core looks like: /tmp/tmpe8urj5yt: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand', real uid: 1000, effective uid: 1000, real gid: 1002, effective gid: 1002, execfn: '/usr/bin/ceph-bluestore-tool', platform: 'x86_64' 2026-02-13T20:24:43.967 INFO:teuthology.task.internal: dump_program: ceph-bluestore-tool 2026-02-13T20:24:43.967 DEBUG:teuthology.orchestra.run.trial030:> which ceph-bluestore-tool 2026-02-13T20:24:43.972 INFO:teuthology.orchestra.run.trial030.stdout:/usr/bin/ceph-bluestore-tool 2026-02-13T20:24:44.018 DEBUG:teuthology.orchestra.remote:trial030:/usr/bin/ceph-bluestore-tool is 242MB 2026-02-13T20:24:45.515 DEBUG:teuthology.orchestra.run.trial030:> mktemp 2026-02-13T20:24:45.518 INFO:teuthology.orchestra.run.trial030.stdout:/tmp/tmp.ZyAEQrxjfy 2026-02-13T20:24:45.518 DEBUG:teuthology.orchestra.run.trial030:> sudo cp /usr/bin/ceph-bluestore-tool /tmp/tmp.ZyAEQrxjfy 2026-02-13T20:24:45.903 DEBUG:teuthology.orchestra.run.trial030:> sudo chmod 0666 /tmp/tmp.ZyAEQrxjfy 2026-02-13T20:24:45.963 DEBUG:teuthology.orchestra.remote:trial030:/tmp/tmp.ZyAEQrxjfy is 242MB 2026-02-13T20:24:47.414 DEBUG:teuthology.orchestra.run.trial030:> rm -fr /tmp/tmp.ZyAEQrxjfy 2026-02-13T20:24:47.452 INFO:teuthology.task.internal:Removing archive directory... 2026-02-13T20:24:47.452 DEBUG:teuthology.orchestra.run.trial030:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T20:24:48.840 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-13T20:24:48.857 INFO:teuthology.task.internal:Not uploading archives. 2026-02-13T20:24:48.857 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-13T20:24:48.868 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-13T20:24:48.869 DEBUG:teuthology.orchestra.run.trial030:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T20:24:48.873 INFO:teuthology.orchestra.run.trial030.stdout: 1180220 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 13 20:24 /home/ubuntu/cephtest 2026-02-13T20:24:48.873 INFO:teuthology.orchestra.run.trial030.stdout: 1190961 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 13 20:08 /home/ubuntu/cephtest/mnt.0 2026-02-13T20:24:48.873 INFO:teuthology.orchestra.run.trial030.stdout: 1190962 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 13 20:18 /home/ubuntu/cephtest/mnt.0/client.0 2026-02-13T20:24:48.873 INFO:teuthology.orchestra.run.trial030.stdout: 1206854 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 13 20:18 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-13T20:24:48.873 INFO:teuthology.orchestra.run.trial030.stdout: 1206855 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Feb 13 20:20 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td 2026-02-13T20:24:48.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T20:24:48.874 INFO:teuthology.orchestra.run.trial030.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2026-02-13T20:24:48.874 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 485, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial030 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-13T20:24:48.875 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-13T20:24:48.886 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-13T20:24:48.900 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on trial030 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-13T20:24:48.906 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} duration: 898.6466906070709 failure_reason: 'Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on trial030 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=afefaa40503a4bf024e96f97dd7f852b75f00ad6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh''' flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-13T20:24:48.906 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T20:24:49.013 INFO:teuthology.run:FAIL